AWS Data Engineer - dubai - NorthBay, LLC

Data engineer with experience designing and maintaining scalable data pipelines using tools like Apache Spark, Kafka and Flink. · ...

We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, · applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines. ...

Design build and maintain data pipelines for batch near Real Time processing Develop manage data ingestion and transformation processes Ensure data quality reliability performance across data platforms Collaborate with data architects scientists analytics teams to support downstr ...

As a Data Engineer you will be at the core of the company s data ecosystem ensuring the data infrastructure is efficient scalable and reliable. · ...

We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · ...

We are looking for a Data Engineer to strengthen our Data Team at Wheely. · ResponsibilitiesEnhance Data team with architectural best practices and low-level optimizations · Cover up business units with feature requests / bugfixes / data quality issues · ...

We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. · 3+ years of exper ...

We are seeking a highly skilled Data Engineer with strong expertise in AWS cloud services to design build and maintain scalable data pipelines architectures. · The ideal candidate will have deep knowledge of data engineering best practices cloud native solutions ability to optimi ...

The Data Engineer is a fully-participating member of a cross-functional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics space. · ...

The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data platforms that support analytics, reporting, and decision-making across the business. · ...

Amana is seeking a highly motivated data engineer with Microsoft Azure & Databricks engineering background to join our Data Science team. · ...

+Job summary · Data engineer needed to build scalable systems for ingesting and processing crypto market data. · +ResponsibilitiesBuild and maintain robust data pipelinesDesign and optimize databasesImplement data quality checksCreate tools for seamless access to clean datasets · ...

A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...

Data Engineer responsible for designing and implementing complex data infrastructure. Develop robust ETL processes and optimize data pipelines using technologies like Apache Spark and Airflow. · Architect and optimize scalable data storage solutions.Design and maintain efficient ...

WeareseekingaData · Engineer(PySpark) · withstrongDatapipelineDevelopment:Design,develop,andmaintainhighlyscalableandoptimizedETLpipelinesusingPySparkonthecClouderaDataPlatform,ensuringdataintegrityandaccuracy.DataPipelineDevelopment:Designdevelop,andmaintainhighlyscalableandopti ...

+Senior Data Engineer responsible for designing scalable data pipelines using PySpark. · +Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience). · 5 years of experience in big data technologies with a focus on Apache Spark and Python. · + ...

Data Engineer responsible for designing building maintaining scalable high-performance data pipelines implementing batch real-time ingestion using tools like Apache Spark Kafka Flink NiFi Airflow etc optimizing data workflow performance quality latency developing maintaining data ...

Data Engineer/Pyspark position in Dubai UAE with experience level of 7 to 9 Years. · ...

A data engineer with expertise in Python Spark and Jupyter will perform daily tasks such as exploratory data analysis EDA imputation techniques data linking cleansing feature engineering Apache Airflow Jenkins scheduling and automation Github Github Actions. · ...

We are looking for an experienced Data Engineer to join our team in Dubai. The ideal candidate will have advanced proficiency in PySpark and experience with Cloudera Data Platform components. · Design, develop and maintain highly scalable and optimized ETL pipelines using PySpark ...

We are looking for a Data Engineer to lead the design, development and maintenance of data solutions that support product teams in leveraging data for their specific needs. · ...