Data Engineer - Dubai - Global Software Solutions Group

    Global Software Solutions Group
    د.إ210,000 - د.إ360,000 (AED) per year *
    Description

    We are seeking a highly skilled Data Engineer with strong expertise in PySpark and the Cloudera Data Platform (CDP) . The ideal candidate will design, develop, and maintain scalable data pipelines while ensuring high data quality, performance, and availability across the organisation.

    This role requires hands‑on experience in big data ecosystems, cloud‑native technologies, and advanced data processing frameworks. You will collaborate with cross‑functional teams to build reliable and high‑performance data solutions that drive business insights.

    Key Responsibilities

    • Data Pipeline Development
    • Design, develop, and maintain scalable ETL/ELT pipelines using PySpark on CDP
    • Ensure data integrity, reliability, and performance optimisation
    • Develop ingestion frameworks to collect data from relational databases, APIs, streaming sources, and file systems
    • Load structured and unstructured data into Data Lake/Data Warehouse environments
    • Process, cleanse, and transform large‑scale datasets using PySpark
    • Build reusable data processing components
    • Tune Spark jobs and Cloudera components for optimal performance
    • Optimise memory, partitioning, and execution plans
    • Reduce ETL runtime and improve cluster efficiency
    • Implement data validation checks and monitoring mechanisms
    • Ensure end‑to‑end data quality and governance standards
    • Automate workflows using tools such as Apache Oozie, Apache Airflow, or similar orchestration frameworks
    • Maintain CI/CD integration for data pipelines
    • Monitor pipeline health and troubleshoot failures
    • Provide production support and continuous improvements

    Required Skills & Qualifications

    • 5+ years of experience in Data Engineering
    • Strong hands‑on experience in PySpark
    • Experience working on Cloudera Data Platform (CDP)
    • Strong knowledge of Hadoop ecosystem (HDFS, Hive, Impala, YARN)
    • Proficiency in SQL and data modelling concepts
    • Experience with workflow orchestration tools (Airflow, Oozie, etc.)
    • Good understanding of data warehousing concepts
    • Experience with performance tuning and optimisation

    Good to Have

    • Experience with cloud platforms (AWS, Azure, GCP)
    • Knowledge of streaming tools (Kafka, Spark Streaming)
    • Exposure to DevOps practices and CI/CD pipelines
    • Banking/Financial Services domain experience
    #J-18808-Ljbffr
    * This salary range is an estimation made by beBee
  • Work in company

    Data Engineer

    Only for registered members

    Position Summary · The · Junior Data Engineer · supports the operation and maintenance of the company's game data infrastructure, ensuring data is accurately collected, processed, and delivered for analytics and reporting. · This role focuses on execution excellence and operation ...

    Dubai, Dubai د.إ210,000 - د.إ360,000 (AED) per year

    1 week ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. · 3+ years of exper ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for an experienced Data Engineer to design develop and optimize data pipelines ETL processes and data integration solutions. · Develop and Maintain Data Pipelines to process structured and unstructured data efficiently. · Implement ETL/ELT Workflows for batch and r ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    +Data engineer responsible for designing developing and maintaining highly scalable ETL pipelines using PySpark on Cloudera Data Platform ensuring data integrity accuracy. · +Data Pipeline Development: Design develop and maintain highly scalable optimized ETL pipelines using PySp ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer responsible for designing and implementing complex data infrastructure. Develop robust ETL processes and optimize data pipelines using technologies like Apache Spark and Airflow. · Architect and optimize scalable data storage solutions.Design and maintain efficient ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a skilled Data Engineer to design, build, and operate scalable data pipelines that power real-time processing and analytics. You will work on high-throughput data systems, ensuring reliability, performance, and maintainability across the data lifecycle — from i ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    5 days ago

  • Work in company

    Data Engineer

    Only for registered members

    Amana is seeking a highly motivated data engineer with Microsoft Azure & Databricks engineering background to join our Data Science team. · ...

    Dubai

    1 month ago

  • Work in company

    data engineer

    Only for registered members

    Data Engineer (PySpark) · Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform. · Implement data ingestion processes from a variety of sources to the data lake or data warehouse on CDP. · ...

    Dubai

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    + We are seeking a highly skilled Senior Data Engineer with strong expertise in dimensional data modeling and modern data architecture patterns to design, build, and maintain scalable analytics-ready data platforms on AWS (and GCP). The ideal candidate has hands-on experience des ...

    Dubai, Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data engineer responsible for designing, building and maintaining data pipelines, lakes and warehouses. Provides technical guidance on infrastructure for analytics and AI use cases. · ...

    Dubai

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · ...

    Dubai

    3 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    Description · We are seeking a highly skilled Data Engineer with strong expertise in PySpark and the Cloudera Data Platform (CDP). The ideal candidate will design, develop, and maintain scalable data pipelines while ensuring high data quality, performance, and availability across ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    1 week ago

  • Work in company

    Data Engineer

    Only for registered members

    WeareseekingaData · Engineer(PySpark) · withstrongDatapipelineDevelopment:Design,develop,andmaintainhighlyscalableandoptimizedETLpipelinesusingPySparkonthecClouderaDataPlatform,ensuringdataintegrityandaccuracy.DataPipelineDevelopment:Designdevelop,andmaintainhighlyscalableandopti ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a Data Engineer to lead the design, development and maintenance of data solutions that support product teams in leveraging data for their specific needs. · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking highly skilled Data Engineer with strong expertise in PySpark on Cloudera Data Platform (CDP) for designing · developing maintaining scalable data pipelines ensuring high data quality performance availability across organisation. · Design develop maintain scalabl ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data platforms that support analytics, reporting, and decision-making across the business. · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data engineer role in Dubai requiring experience in big data platforms and AI solutions. Key accountabilities include designing and maintaining pipelines, lakes, and warehouses. · Design build maintain data pipelines lakes warehouses. · Develop ETL jobs stored procedures function ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a Data Engineer to strengthen our Data Team at Wheely. · ResponsibilitiesEnhance Data team with architectural best practices and low-level optimizations · Cover up business units with feature requests / bugfixes / data quality issues · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    As a Data Engineer you will be at the core of the company s data ecosystem ensuring the data infrastructure is efficient scalable and reliable. · ...

    Dubai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Job Description: · We are seeking a skilled Data Engineer to design and build scalable data ingestion pipelines into · Microsoft Fabric Lakehouses · . Your primary focus will be integrating data from multiple school systems and platforms, ensuring high performance and reliability ...

    Dubai د.إ210,000 - د.إ360,000 (AED) per year

    1 week ago

Jobs
>
Data engineer
>
Jobs for Data engineer in Dubai