Data Engineer - abu dhabi - Riverflex

    Riverflex
    Riverflex abu dhabi

    3 hours ago

    Description

    Job Title:
    Data Engineer – Automation & AI

    Location:
    UAE – Abu Dhabi or DubaiEngagement: Full-time (On-site)

    Contract duration: 3 months + possible extensions Start date: February 2026

    Riverflex is partnering with a leading financial institution in the UAE on a strategic Proof of Concept focused on increasing data engineering productivity through automation and AI.

    We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines.

    This role is explicitly focused on accelerating data engineering ways of working using AI, not solely on building pipelines.

    You will act as the internal lead on how AI should be applied in day-to-day data engineering, working closely with the partner's Data Lead and embedded with the on-site engineering team.

    A key part of the scope is translating legacy SQL and stored procedures into modern AWS Glue pipelines, while defining practical AI patterns, tool and guardrails that scale beyond the PoC.

    Responsibilities
    Data engineering & pipeline delivery
    Design, build, and evolve AWS Glue–based data pipelines using Spark and SQL.
    Translate legacy SQL scripts and stored procedures into AWS Glue pipelines.
    Ensure migrated and newly built pipelines meet agreed standards for correctness, performance, and maintainability.
    AI-driven engineering acceleration
    Apply Generative AI and agent-based techniques to accelerate data engineering tasks, including code generation/refactoring, pipeline development and standardisation.
    Own the design and implementation of AI-assisted tooling that integrates directly into day-to-day engineering workflows.
    Codify successful patterns, reusable tools, and recommended ways of working for scaling beyond the PoC.
    AI tooling & experimentation
    Work hands-on with Python and LLM APIs to build pragmatic, internal DE tools.
    Design effective prompts & interaction patterns for code generation & transformation.
    Evaluate and work with enterprise-grade AI platforms (e.g. AWS Bedrock, Azure AI Foundry) using GPT-4 / Claude-class models.
    Define practical rules of thumb and guardrails (e.g. where automation works, where it breaks down, where human intervention is required).
    Collaboration & ways-of-working

    Work closely with data and platform engineers to (dis)prove automation hypotheses and identify where AI adds real productivity gains vs.

    noise.

    Document outcomes and recommendations from the PoC and provide clear guidance on how AI should (and should not) be used in data engineering at scale.

    Qualifications
    6+ years of experience in data engineering or closely related engineering roles.
    Proven experience owning and shaping data engineering solutions, not only implementing individual pipelines.

    Strong hands-on experience with AWS-based data engineering, including:
    AWS Glue (jobs, transformations, orchestration)
    Spark (batch processing and transformations)
    Advanced SQL (complex logic, optimisation, performance tuning)
    End-to-end pipeline and workflow design
    Solid (Python) engineering experience, including building reusable components and internal tooling.
    Demonstrated, practical experience applying Generative AI in engineering workflows, such as:
    Working with LLM APIs (e.g. AWS Bedrock, Azure AI Foundry, OpenAI)
    Prompt design for code generation, refactoring, and transformation
    Understanding the limitations, failure modes, and risks of LLM-based automation
    Experience designing AI-assisted engineering workflows or tools, for example:
    API-based services (e.g. FastAPI)
    CPA (or agent)-like orchestration patterns
    Able to balance short-term PoC delivery with longer-term capability building.
    Experience in financial services or other regulated environments is a strong advantage.

    Ability to be based in the UAE for a minimum of 3 months, working full-time on-site (Abu Dhabi or Dubai).

    This is a unique opportunity to directly impact the data engineering capability of a major financial institution, with real, hands-on use of GenAI - while working on-site in the UAE, at the heart of one of the world's fastest-growing technology and financial hubs.

    You will operate in a high-impact setting alongside senior stakeholders on a greenfield AI for Data Engineering initiative with strong executive backing.

    Apply now
    #J-18808-Ljbffr

  • Data Engineer

    5 days ago

    Only for registered members Abu Dhabi

    In a world of possibilities, pursue one with endless opportunities. · ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi

    As Data Engineer you will gather, curate and prepare high-quality datasets to support cutting-edge research. · ...

  • Data Engineer

    1 week ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Data Engineer in Abu Dhabi, UAE required to design and maintain scalable data pipelines, curate complex datasets, and ensure high-quality reliable data. Experience in big data architectures and cloud platforms required. · ...

  • Data Engineer

    3 weeks ago

    Only for registered members Abu Dhabi

    We are looking for a Data Engineer who can build scalable data pipelines while also developing intelligent AI solutions using Azure Agent Foundry, OpenAI services, LangChain, Databricks, and modern cloud architectures. · ...

  • Data Engineer

    1 week ago

    Institute of Foundation Models Abu Dhabi

    Job summary · Data Engineer specializing in Natural Language Processing (NLP) and large-scale data processing will gather curate and prepare high-quality datasets to support cutting-edge NLP research. · ResponsibilitiesRapidly collect curate and preprocess datasets based on detai ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Durlston Partners is partnering with a leading Quant Trading firm that leverages advanced data and technology to execute market-beating strategies. They are seeking a Data Engineer to design, build, and scale the data infrastructure powering research and trading systems seamless ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We have partnered with a specialist UK-based buy-side consultancy supporting a major investment management firm in Abu Dhabi who are looking to hire an experienced Data Engineer on an initial 12-month contract. · ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    The Data Engineer is responsible for designing, implementing and optimising data pipelines and infrastructure to support cutting-edge AI systems. · Design develop and maintain scalable reliable data pipelines to ingest transform and load diverse datasets from various sources incl ...

  • Data Engineer

    1 week ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    A Purview Developer with a Data Engineering background specializes in implementing enterprise data governance, cataloguing, lineage, and compliance using Microsoft Purview. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Abu Dhabi

    +We are seeking an experienced Data Engineer (PySpark) to design, build, optimize, and maintain scalable data pipelines for production environments.The role requires strong hands-on experience in big data processing, pipeline optimization,+and deployment using modern data enginee ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We are looking for a Data Engineer who can build scalable data pipelines while also developing intelligent AI solutions using Azure Agent Foundry, OpenAI services, LangChain, Databricks and modern cloud architectures. · The ideal candidate has strong data engineering foundations ...

  • Data Engineer

    2 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Candidates with a Master of Science in Data Analytics or bachelor's degree in computer science/engineering are required for this position. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We are looking for a Data Engineer to enhance our internal data engineering capability from the UAE and play a key role in developing the data infrastructure and systems alongside our UK Team, · Receiving large datasets and transforming them to enable our mission teams to rapidly ...

  • Data Engineer

    2 weeks ago

    Only for registered members Abu Dhabi

    Job summary · We are looking for a Data Engineer to enhance our internal data engineering capability from the UAE and play a key role in developing the data infrastructure and systems alongside our UK Team. · ,ResponsibilitiesReceiving large datasets and transforming them to enab ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Designs builds and optimizes scalable data infrastructure and pipelines to process manage both structured unstructured data powering advanced AI solutions. · ...

  • Data Engineer

    4 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We are currently looking for Data Engineer profiles with Microsoft Purview experience. · Design, develop and maintain scalable data pipelines and ETL/ELT processes to ingest process transform large volumes of structured unstructured data. · ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We're looking for a hands-on data engineer to build and scale the data foundation that powers research and trading. · Design, implement, and own end-to-end ETL/ELT pipelines (batch and streaming) from ingestion to feature delivery. · ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    The Big Data Analytics Center (BIDAC) at UAE University is expanding its research and innovation team to advance the next generation of AI, Machine Learning, and Large Language Model (LLM) applications. · Design, build, and maintain data pipelines, ETL workflows, and databases su ...

  • DATA ENGINEER

    1 week ago

    Star Services Abu Dhabi, United Arab Emirates

    We are seeking a highly skilled and experienced Data Warehouse and Machine Learning Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining data warehousing solutions such as Redshift, · Big Query or Snowflake.Designing developi ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi

    We're looking for a hands-on Data Engineer to build and scale the data foundation that powers research and trading. · Design schemas pipelines storage layers across relational NoSQL vector databases. · Productionize ETL/ELT public clouds partner researchers model complex financia ...

  • Data Engineer

    4 weeks ago

    Only for registered members Abu Dhabi

    We are currently looking for Data Engineer profiles with Microsoft Purview experience. The role focuses on building and maintaining scalable data pipelines while ensuring robust data governance, cataloguing, and compliance across enterprise data platforms. · Design, develop, and ...

Jobs
>
Data engineer
>
Jobs for Data engineer in Abu Dhabi