- Data Pipeline Development
- Design, develop, and maintain scalable ETL/ELT pipelines using PySpark on CDP
- Ensure data integrity, reliability, and performance optimisation
- Develop ingestion frameworks to collect data from relational databases, APIs, streaming sources, and file systems
- Load structured and unstructured data into Data Lake/Data Warehouse environments
- Process, cleanse, and transform large‑scale datasets using PySpark
- Build reusable data processing components
- Tune Spark jobs and Cloudera components for optimal performance
- Optimise memory, partitioning, and execution plans
- Reduce ETL runtime and improve cluster efficiency
- Implement data validation checks and monitoring mechanisms
- Ensure end‑to‑end data quality and governance standards
- Automate workflows using tools such as Apache Oozie, Apache Airflow, or similar orchestration frameworks
- Maintain CI/CD integration for data pipelines
- Monitor pipeline health and troubleshoot failures
- Provide production support and continuous improvements
- 5+ years of experience in Data Engineering
- Strong hands‑on experience in PySpark
- Experience working on Cloudera Data Platform (CDP)
- Strong knowledge of Hadoop ecosystem (HDFS, Hive, Impala, YARN)
- Proficiency in SQL and data modelling concepts
- Experience with workflow orchestration tools (Airflow, Oozie, etc.)
- Good understanding of data warehousing concepts
- Experience with performance tuning and optimisation
- Experience with cloud platforms (AWS, Azure, GCP)
- Knowledge of streaming tools (Kafka, Spark Streaming)
- Exposure to DevOps practices and CI/CD pipelines
- Banking/Financial Services domain experience
-
Position Summary · The · Junior Data Engineer · supports the operation and maintenance of the company's game data infrastructure, ensuring data is accurately collected, processed, and delivered for analytics and reporting. · This role focuses on execution excellence and operation ...
Dubai, Dubai د.إ210,000 - د.إ360,000 (AED) per year1 week ago
-
We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. · 3+ years of exper ...
Dubai1 month ago
-
We are looking for an experienced Data Engineer to design develop and optimize data pipelines ETL processes and data integration solutions. · Develop and Maintain Data Pipelines to process structured and unstructured data efficiently. · Implement ETL/ELT Workflows for batch and r ...
Dubai1 month ago
-
+Data engineer responsible for designing developing and maintaining highly scalable ETL pipelines using PySpark on Cloudera Data Platform ensuring data integrity accuracy. · +Data Pipeline Development: Design develop and maintain highly scalable optimized ETL pipelines using PySp ...
Dubai1 month ago
-
Data Engineer responsible for designing and implementing complex data infrastructure. Develop robust ETL processes and optimize data pipelines using technologies like Apache Spark and Airflow. · Architect and optimize scalable data storage solutions.Design and maintain efficient ...
Dubai1 month ago
-
We are looking for a skilled Data Engineer to design, build, and operate scalable data pipelines that power real-time processing and analytics. You will work on high-throughput data systems, ensuring reliability, performance, and maintainability across the data lifecycle — from i ...
Dubai د.إ210,000 - د.إ360,000 (AED) per year5 days ago
-
Amana is seeking a highly motivated data engineer with Microsoft Azure & Databricks engineering background to join our Data Science team. · ...
Dubai1 month ago
-
Data Engineer (PySpark) · Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform. · Implement data ingestion processes from a variety of sources to the data lake or data warehouse on CDP. · ...
Dubai2 weeks ago
-
+ We are seeking a highly skilled Senior Data Engineer with strong expertise in dimensional data modeling and modern data architecture patterns to design, build, and maintain scalable analytics-ready data platforms on AWS (and GCP). The ideal candidate has hands-on experience des ...
Dubai, Dubai1 month ago
-
Data engineer responsible for designing, building and maintaining data pipelines, lakes and warehouses. Provides technical guidance on infrastructure for analytics and AI use cases. · ...
Dubai2 weeks ago
-
We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · ...
Dubai3 weeks ago
-
Description · We are seeking a highly skilled Data Engineer with strong expertise in PySpark and the Cloudera Data Platform (CDP). The ideal candidate will design, develop, and maintain scalable data pipelines while ensuring high data quality, performance, and availability across ...
Dubai د.إ210,000 - د.إ360,000 (AED) per year1 week ago
-
WeareseekingaData · Engineer(PySpark) · withstrongDatapipelineDevelopment:Design,develop,andmaintainhighlyscalableandoptimizedETLpipelinesusingPySparkonthecClouderaDataPlatform,ensuringdataintegrityandaccuracy.DataPipelineDevelopment:Designdevelop,andmaintainhighlyscalableandopti ...
Dubai1 month ago
-
A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...
Dubai1 month ago
-
We are looking for a Data Engineer to lead the design, development and maintenance of data solutions that support product teams in leveraging data for their specific needs. · ...
Dubai1 month ago
-
We are seeking highly skilled Data Engineer with strong expertise in PySpark on Cloudera Data Platform (CDP) for designing · developing maintaining scalable data pipelines ensuring high data quality performance availability across organisation. · Design develop maintain scalabl ...
Dubai د.إ210,000 - د.إ360,000 (AED) per year2 weeks ago
-
The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data platforms that support analytics, reporting, and decision-making across the business. · ...
Dubai1 month ago
-
Data engineer role in Dubai requiring experience in big data platforms and AI solutions. Key accountabilities include designing and maintaining pipelines, lakes, and warehouses. · Design build maintain data pipelines lakes warehouses. · Develop ETL jobs stored procedures function ...
Dubai1 month ago
-
We are looking for a Data Engineer to strengthen our Data Team at Wheely. · ResponsibilitiesEnhance Data team with architectural best practices and low-level optimizations · Cover up business units with feature requests / bugfixes / data quality issues · ...
Dubai1 month ago
-
As a Data Engineer you will be at the core of the company s data ecosystem ensuring the data infrastructure is efficient scalable and reliable. · ...
Dubai1 month ago
-
Job Description: · We are seeking a skilled Data Engineer to design and build scalable data ingestion pipelines into · Microsoft Fabric Lakehouses · . Your primary focus will be integrating data from multiple school systems and platforms, ensuring high performance and reliability ...
Dubai د.إ210,000 - د.إ360,000 (AED) per year1 week ago
Data Engineer - Dubai - Global Software Solutions Group
Description
We are seeking a highly skilled Data Engineer with strong expertise in PySpark and the Cloudera Data Platform (CDP) . The ideal candidate will design, develop, and maintain scalable data pipelines while ensuring high data quality, performance, and availability across the organisation.
This role requires hands‑on experience in big data ecosystems, cloud‑native technologies, and advanced data processing frameworks. You will collaborate with cross‑functional teams to build reliable and high‑performance data solutions that drive business insights.
Key Responsibilities
Required Skills & Qualifications
Good to Have
-
Data Engineer
Only for registered members Dubai, Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
data engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai, Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
-
Data Engineer
Only for registered members Dubai
