Senior AWS Data Engineer - Dubai, Dubai, United Arab Emirates - NorthBay Solutions

    NorthBay Solutions
    NorthBay Solutions Dubai, Dubai, United Arab Emirates

    1 week ago

    Description

    Job Title: Senior AWS Data Engineer / Data Platform Engineer

    Experience: 8+ Years
    Location: Dubai, UAE (Onsite)
    Employment Type: Full-Time

    Position Overview

    We are seeking a highly experienced Senior AWS Data Engineer to design, build, and optimize large-scale data platforms on AWS. The ideal candidate will have deep hands-on experience with AWS data services, batch and streaming data processing, and orchestration frameworks, playing a key role in architecting and maintaining enterprise-grade data solutions.

    Key Responsibilities

    • Design, develop, and optimize scalable data pipelines using AWS native services
    • Lead the implementation of batch and near-real-time data processing solutions
    • Architect and manage data ingestion, transformation, and storage layers
    • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
    • Orchestrate complex data workflows using Apache Airflow (MWAA)
    • Develop and manage serverless data processing using AWS Lambda
    • Design and optimize data warehouses using Amazon Redshift
    • Implement and manage NoSQL data models using Amazon DynamoDB
    • Utilize AWS DataZone for data governance, cataloging, and access management
    • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
    • Ensure data security, quality, performance, and cost optimization
    • Collaborate with architects, analytics teams, and business stakeholders
    • Provide technical guidance and mentorship to junior team members

    Required Skills & Experience

    • 8+ years of experience in data engineering and data platform development
    • Strong hands-on experience with:
      • AWS Glue
      • Amazon EMR (Spark)
      • AWS Lambda
      • Apache Airflow (MWAA)
      • Amazon EC2
      • Amazon CloudWatch
      • Amazon Redshift
      • Amazon DynamoDB
      • AWS DataZone
    • Strong experience with batch data processing architectures
    • Proficiency in SQL, Python, and Spark
    • Experience working with large-scale datasets and distributed systems
    • Strong understanding of data modeling, data warehousing, and ETL patterns
    • Experience with CI/CD pipelines and Infrastructure as Code is a plus

    Nice to Have

    • AWS Certification (Data Analytics / Solutions Architect)
    • Experience with data governance and metadata management
    • Exposure to data lake and lakehouse architectures

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai

    Amana is seeking a highly motivated data engineer with Microsoft Azure & Databricks engineering background to join our Data Science team. · ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai

    Data engineer role in Dubai requiring experience in big data platforms and AI solutions. Key accountabilities include designing and maintaining pipelines, lakes, and warehouses. · Design build maintain data pipelines lakes warehouses. · Develop ETL jobs stored procedures function ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai, Dubai

    + We are seeking a highly skilled Senior Data Engineer with strong expertise in dimensional data modeling and modern data architecture patterns to design, build, and maintain scalable analytics-ready data platforms on AWS (and GCP). The ideal candidate has hands-on experience des ...

  • Data Engineer

    4 weeks ago

    Only for registered members Dubai

    Data Engineer responsible for designing and implementing complex data infrastructure. Develop robust ETL processes and optimize data pipelines using technologies like Apache Spark and Airflow. · Architect and optimize scalable data storage solutions.Design and maintain efficient ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai

    We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. · 3+ years of exper ...

  • Data Engineer

    3 weeks ago

    Only for registered members Dubai

    We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, · applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines. ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai

    We are seeking a Senior Data Engineer with strong expertise in PySpark and Python, capable of building scalable, high-performance data pipelines. · ...

  • Data Engineer

    1 week ago

    Only for registered members Dubai

    WeareseekingaData · Engineer(PySpark) · withstrongDatapipelineDevelopment:Design,develop,andmaintainhighlyscalableandoptimizedETLpipelinesusingPySparkonthecClouderaDataPlatform,ensuringdataintegrityandaccuracy.DataPipelineDevelopment:Designdevelop,andmaintainhighlyscalableandopti ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai, Dubai

    The Data Engineer is a fully-participating member of a cross-functional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics space. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai

    Design build and maintain data pipelines for batch near Real Time processing Develop manage data ingestion and transformation processes Ensure data quality reliability performance across data platforms Collaborate with data architects scientists analytics teams to support downstr ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai, Dubai

    We are looking for a Data Engineer intern to participate in exciting projects covering the end-to-end data lifecycle - from raw data integrations with primary and third-party systems, through advanced data modelling, to state-of-the-art data visualisation and development of innov ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai

    +Senior Data Engineer responsible for designing scalable data pipelines using PySpark. · +Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience). · 5 years of experience in big data technologies with a focus on Apache Spark and Python. · + ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai, Dubai

    The Data Engineer plays a key role in maintaining the quality of data insights solutions and ensuring alignment with business objectives. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai

    Data Engineer/Pyspark position in Dubai UAE with experience level of 7 to 9 Years. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai

    A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai

    We are looking for an experienced Data Engineer to join our team in Dubai. The ideal candidate will have advanced proficiency in PySpark and experience with Cloudera Data Platform components. · Design, develop and maintain highly scalable and optimized ETL pipelines using PySpark ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai

    We are looking for an experienced Data Engineer to design develop and optimize data pipelines ETL processes and data integration solutions. · Develop and Maintain Data Pipelines to process structured and unstructured data efficiently. · Implement ETL/ELT Workflows for batch and r ...

  • Data Engineer

    1 month ago

    Only for registered members Dubai

    We are looking for a Data Engineer to lead the design, development and maintenance of data solutions that support product teams in leveraging data for their specific needs. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dubai

    +Data engineer responsible for designing developing and maintaining highly scalable ETL pipelines using PySpark on Cloudera Data Platform ensuring data integrity accuracy. · +Data Pipeline Development: Design develop and maintain highly scalable optimized ETL pipelines using PySp ...

  • data engineer

    2 days ago

    Only for registered members Dubai

    Data Engineer (PySpark) · Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform. · Implement data ingestion processes from a variety of sources to the data lake or data warehouse on CDP. · ...

  • Data Engineer

    5 days ago

    Only for registered members Dubai

    We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · ...

Jobs
>
Dubai