Senior Data Engineer - Dubai, United Arab Emirates - Core42

    Core42
    Core42 Dubai, United Arab Emirates

    2 weeks ago

    Default job background
    Description

    Qualifications

    Skillsand attributes to success

    • Bachelor's degree inComputer Science, Engineering, Mathematics, or a related field; orequivalent work experience.
    • 5+ years ofexperience in a Data Engineeringrole.
    • Proficiency in SQL and programminglanguages like Python, Java, andScala.
    • Hands-on experience with big datatechnologies like Hadoop, Spark andFlink.
    • Familiarity with machine learningframeworks such as TensorFlow, PyTorch, orsimilar.
    • Strong understanding of datawarehousing concepts, ETL processes, and datamodeling.
    • Experience with API development andintegration with data services.
    • Experience withcloud platforms like AWS, GCP.
    • Knowledge inDevOps, CI/CD methods, and containerization technologies likeDocker or Kubernetes.
    • Experience with real-timedata processing.

    Technical stack

    • Programming Languages: Python, Java,Scala, SQL, Bash
    • Big Data Technologies: Hadoop,Spark, Flink
    • Databases: MySQL, PostgreSQL,MongoDB, Cassandra, HBase, Redis
    • CloudPlatforms: Azure
    • API Development: RESTful APIs,GraphQL, OpenAPI
    • Data Services: Kafka,RabbitMQ
    • Containers: Docker,Kubernetes