Senior PySpark Data Engineer for CDP ETL Pipelines - dubai - GSS Tech Group

We are seeking a highly experienced Senior Data Engineer with strong expertise in end-to-end ETL pipeline implementation and mandatory experience with Azure Data Factory (ADF). · ...

I am looking for a Senior Data Engineer to own the design, development and optimization of end-to-end data engineering solutions on the Databricks platform. This role will focus on building scalable ETL pipelines robust data models and high-quality data layers that power advanced ...

We are seeking a Data Analytics Engineer to design and maintain ETL pipelines automate data workflows and create insightful visualizations The ideal candidate will have expertise in SQL MS SQL PostgreSQL Oracle Python APIs SSIS/SSRS and data visualization tools like Power BI Tabl ...

Support batch and streaming data processing using Python and distributed data frameworks such as Apache Spark. · Assist in building and maintaining data pipelines for structured and semi-structured data. · ...

Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, · e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP. · Data Transformation and Processing: Use PySpark to process, · routines to ensure data accuracy ...

Data engineer responsible for designing, developing and maintaining highly scalable ETL pipelines using PySpark on the Cloudera Data Platform. · Data Pipeline Development: Design and develop data ingestion processes from various sources to the data lake or warehouse on CDP. · Dat ...

A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...

+Data engineer responsible for designing developing and maintaining highly scalable ETL pipelines using PySpark on Cloudera Data Platform ensuring data integrity accuracy. · +Data Pipeline Development: Design develop and maintain highly scalable optimized ETL pipelines using PySp ...

This is a full-time on-site role for a Data Engineer specializing in ETL and Streaming technologies based in Dubai. · Design develop and optimize scalable data pipelines including ETL processes build and manage data models support data warehousing analytics initiatives daily task ...

Data Engineer with PySpark and Cloudera Data Platform experience. Design and develop scalable ETL pipelines for data integration. · ...

WeareseekingaData · Engineer(PySpark) · withstrongDatapipelineDevelopment:Design,develop,andmaintainhighlyscalableandoptimizedETLpipelinesusingPySparkonthecClouderaDataPlatform,ensuringdataintegrityandaccuracy.DataPipelineDevelopment:Designdevelop,andmaintainhighlyscalableandopti ...

The Data Engineer – Data Lake is responsible for designing building and maintaining scalable data pipelines and a modern cloud data lake architecture. · ...

We are seeking a Professional Data Engineer to join our dynamic team, where you will play a crucial role in developing and maintaining robust data solutions. · ...

We are seeking a Professional Data Engineer to join our dynamic team, where you will play a crucial role in developing and maintaining robust data solutions. As a Professional Data Engineer, you will collaborate with data science, business analytics, and product development teams ...

We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. · 3+ years of exper ...

The Manager Data Engineering is responsible for shaping and executing the data engineering strategy. · Lead data engineering initiatives for business intelligence analytics reporting improving performance scalability existing use cases · Translate business requirements into data ...

The Manager Data Engineering is responsible for shaping and executing the data engineering strategy building robust data warehouses and pipelines delivering reliable analytics and Power BI solutions that transform complex datasets into actionable business insights for stakeholder ...

Job summary: · A highly skilled Data Engineer with deep expertise in PySpark and Cloudera Data Platform (CDP) seeks a role designing scalable data pipelines ensuring high-quality availability across organizations. · ...

+Transform and improve performance of existing reporting & analytics use cases with more efficient and state of the art data engineering solutions Contribute to business analysis of the OLTP and OLAP data and in decision support with extensive database programming Understand busi ...

The Manager Data Engineering is responsible for shaping and executing the data engineering strategy. · ...

We are looking for an experienced Data Engineer to join our team in Dubai. The ideal candidate will have advanced proficiency in PySpark and experience with Cloudera Data Platform components. · Design, develop and maintain highly scalable and optimized ETL pipelines using PySpark ...