AWS Glue Data Engineer - dubai - Deeplight

    Deeplight
    Deeplight dubai

    1 week ago

    Description

    OverviewDeepLight AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking.

    ResponsibilitiesBuild scalable ingestion pipelines using AWS Glue, PySpark, and ETL pipeline development.

    Implement AWS Glue jobs for Bronze layer ingestion, applying defined standards and and execute historical loading mechanisms to bring legacy data into the Lakehouse.

    Optimize Glue job performance (DPU allocation, parallelization, partitioning) according to best practices.
    Collaborate with platform teams to ensure tooling and optimization alignment.

    Automate migration of source tables to Bronze layer, leveraging AI-enabled jobs and automate production deployment via Git and Terraform.

    Establish source system connectivity into CDP in collaboration with source system owners.
    Ensure jobs comply with data contracts and monitoring standards.
    Prepare documentation and handover to operational support teams.
    Work closely with Data Architect for ingestion patterns and standards.
    Coordinate with Data Assurance Lead to apply quality checks across all jobs.

    Partner with platform engineers for tooling and + years' experience in data engineering roles, with hands‑on experience in AWS Glue.

    Proficiency in AWS Glue, PySpark, and ETL pipeline development.
    Substantial knowledge of Lakehouse architecture and Medallion design principles.

    Familiarity with CDC, delta loads, and historical data ingestion with AWS services:
    Glue, S3, Athena, Lambda.

    Competence in Git and Terraform for CI/CD of data quality frameworks (e.g., Soda Core).Strong communication skills and ability to engage with various stakeholder levels.

    Experience working in fast‑paced environments and delivering aggressive migration targets.
    Familiarity with Jira and agile methodologies.

    Benefits & Growth OpportunitiesCompetitive salary and performance bonusesComprehensive health insuranceProfessional development and certification supportOpportunity to work on cutting‑edge AI projectsFlexible working arrangementsCareer advancement opportunities in a rapidly growing AI companyWe are committed to fostering an inclusive environment where individuals with different thinking styles can thrive and contribute their unique strengths to our specialised AI and data solutions.

    All candidates are encouraged to request reasonable adjustments to the application process, should the need arise.
    #J-18808-Ljbffr

  • Work in company

    Data Engineer

    Only for registered members

    Position Summary · The · Junior Data Engineer · supports the operation and maintenance of the company's game data infrastructure, ensuring data is accurately collected, processed, and delivered for analytics and reporting. · This role focuses on execution excellence and operation ...

    Dubai, Dubai د.إ210,000 - د.إ360,000 (AED) per year

    1 week ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer/Pyspark position in Dubai UAE with experience level of 7 to 9 Years. · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. · 3+ years of exper ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer responsible for designing and implementing complex data infrastructure. Develop robust ETL processes and optimize data pipelines using technologies like Apache Spark and Airflow. · Architect and optimize scalable data storage solutions.Design and maintain efficient ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for an experienced Data Engineer to design develop and optimize data pipelines ETL processes and data integration solutions. · Develop and Maintain Data Pipelines to process structured and unstructured data efficiently. · Implement ETL/ELT Workflows for batch and r ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    +Data engineer responsible for designing developing and maintaining highly scalable ETL pipelines using PySpark on Cloudera Data Platform ensuring data integrity accuracy. · +Data Pipeline Development: Design develop and maintain highly scalable optimized ETL pipelines using PySp ...

    Dubai

    1 month ago

  • Work in company

    data engineer

    Only for registered members

    Data Engineer (PySpark) · Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform. · Implement data ingestion processes from a variety of sources to the data lake or data warehouse on CDP. · ...

    Dubai

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    + We are seeking a highly skilled Senior Data Engineer with strong expertise in dimensional data modeling and modern data architecture patterns to design, build, and maintain scalable analytics-ready data platforms on AWS (and GCP). The ideal candidate has hands-on experience des ...

    Dubai, Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data engineer responsible for designing, building and maintaining data pipelines, lakes and warehouses. Provides technical guidance on infrastructure for analytics and AI use cases. · ...

    Dubai

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    Amana is seeking a highly motivated data engineer with Microsoft Azure & Databricks engineering background to join our Data Science team. · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking · two experienced Data Engineers · to join a time-bound delivery programme based in Dubai. This engagement will focus on designing and building robust data ingestion pipelines into Microsoft Fabric Lakehouses across multiple school systems. · This is a hands-on, de ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    1 week ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · ...

    Dubai

    3 weeks ago

  • Work in company

    Data engineer

    Only for registered members

    Job Title: Data Engineer (PySpark) · About the Role · We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and ma ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    1 week ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, · applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines. ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a Data Engineer to strengthen our Data Team at Wheely. · ResponsibilitiesEnhance Data team with architectural best practices and low-level optimizations · Cover up business units with feature requests / bugfixes / data quality issues · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a skilled Data Engineer to design, build, and operate scalable data pipelines that power real-time processing and analytics. You will work on high-throughput data systems, ensuring reliability, performance, and maintainability across the data lifecycle — from i ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    5 days ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking highly skilled Data Engineer with strong expertise in PySpark on Cloudera Data Platform (CDP) for designing · developing maintaining scalable data pipelines ensuring high data quality performance availability across organisation. · Design develop maintain scalabl ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Design build and maintain data pipelines for batch near Real Time processing Develop manage data ingestion and transformation processes Ensure data quality reliability performance across data platforms Collaborate with data architects scientists analytics teams to support downstr ...

    Dubai

    1 month ago

  • Work in company Remote job

    Data Engineer

    Only for registered members

    About Us · We are an early-stage startup building a heavy duty AI platform for M&A, powered by deep financial and company data. We process massive amounts of unstructured data from raw web scraping to parsing complex PDF annual reports and earnings transcripts using LLMs to extra ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    4 days ago

  • Work in company

    Data Engineer

    Only for registered members

    WeareseekingaData · Engineer(PySpark) · withstrongDatapipelineDevelopment:Design,develop,andmaintainhighlyscalableandoptimizedETLpipelinesusingPySparkonthecClouderaDataPlatform,ensuringdataintegrityandaccuracy.DataPipelineDevelopment:Designdevelop,andmaintainhighlyscalableandopti ...

    Dubai

    1 month ago

Jobs
>
Dubai