AI Data Engineer - Dubai, United Arab Emirates - Caliberly

Data Engineer responsible for designing and implementing complex data infrastructure. Develop robust ETL processes and optimize data pipelines using technologies like Apache Spark and Airflow. · Architect and optimize scalable data storage solutions.Design and maintain efficient ...

+Senior Data Engineer responsible for designing scalable data pipelines using PySpark. · +Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience). · 5 years of experience in big data technologies with a focus on Apache Spark and Python. · + ...

+ We are seeking a highly skilled Senior Data Engineer with strong expertise in dimensional data modeling and modern data architecture patterns to design, build, and maintain scalable analytics-ready data platforms on AWS (and GCP). The ideal candidate has hands-on experience des ...

Data engineer responsible for designing, building and maintaining data pipelines, lakes and warehouses. Provides technical guidance on infrastructure for analytics and AI use cases. · ...

We are seeking a Senior Data Engineer with strong expertise in PySpark and Python, capable of building scalable, high-performance data pipelines. · ...

We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · ...

Data engineer role in Dubai requiring experience in big data platforms and AI solutions. Key accountabilities include designing and maintaining pipelines, lakes, and warehouses. · Design build maintain data pipelines lakes warehouses. · Develop ETL jobs stored procedures function ...

A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...

We are seeking highly skilled Data Engineer with strong expertise in PySpark on Cloudera Data Platform (CDP) for designing · developing maintaining scalable data pipelines ensuring high data quality performance availability across organisation. · Design develop maintain scalabl ...

Data Engineer (PySpark) · Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform. · Implement data ingestion processes from a variety of sources to the data lake or data warehouse on CDP. · ...

The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data platforms that support analytics, reporting, and decision-making across the business. · ...

Data Engineer/Pyspark position in Dubai UAE with experience level of 7 to 9 Years. · ...

A data engineer with expertise in Python Spark and Jupyter will perform daily tasks such as exploratory data analysis EDA imputation techniques data linking cleansing feature engineering Apache Airflow Jenkins scheduling and automation Github Github Actions. · ...

Description · We are seeking a highly skilled Data Engineer with strong expertise in PySpark and the Cloudera Data Platform (CDP). The ideal candidate will design, develop, and maintain scalable data pipelines while ensuring high data quality, performance, and availability across ...

We are looking for a Data Engineer to strengthen our Data Team at Wheely. · ResponsibilitiesEnhance Data team with architectural best practices and low-level optimizations · Cover up business units with feature requests / bugfixes / data quality issues · ...

We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, · applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines. ...

The Data Engineer plays a key role in maintaining the quality of data insights solutions and ensuring alignment with business objectives. · ...

We are looking for a skilled Data Engineer to join our team. · Design build maintain data pipelines models Write optimize SQL queries analytics reporting Develop manage transformations dbt Work Python pandas data processing analysis Orchestrate workflows Apache Airflow Support da ...

Design build and maintain data pipelines for batch near Real Time processing Develop manage data ingestion and transformation processes Ensure data quality reliability performance across data platforms Collaborate with data architects scientists analytics teams to support downstr ...

Key Responsibilities · Design, develop, and maintain scalable ETL/ELT pipelines using PySpark on CDP · Ensure data integrity, reliability, and performance optimisation · Develop ingestion frameworks to collect data from relational databases, APIs, streaming sources, and file syst ...

As a Data Engineer you will be at the core of the company s data ecosystem ensuring the data infrastructure is efficient scalable and reliable. · ...