Senior Data Engineer - Dubai, United Arab Emirates - Core42

    Core42
    Core42 Dubai, United Arab Emirates

    Found in: DrJobEN AE A2 - 2 weeks ago

    Default job background
    Description

    Qualifications

    Skills and attributes to success

    • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.
    • 5+ years of experience in a Data Engineering role.
    • Proficiency in SQL and programming languages like Python, Java, and Scala.
    • Hands-on experience with big data technologies like Hadoop, Spark and Flink.
    • Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or similar.
    • Strong understanding of data warehousing concepts, ETL processes, and data modeling.
    • Experience with API development and integration with data services.
    • Experience with cloud platforms like AWS, GCP.
    • Knowledge in DevOps, CI/CD methods, and containerization technologies like Docker or Kubernetes.
    • Experience with real-time data processing.

    Technical stack

    • Programming Languages: Python, Java, Scala, SQL, Bash
    • Big Data Technologies: Hadoop, Spark, Flink
    • Databases: MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
    • Cloud Platforms: Azure
    • API Development: RESTful APIs, GraphQL, OpenAPI
    • Data Services: Kafka, RabbitMQ
    • Containers: Docker, Kubernetes