Azure Data Engineer - Dubai
2 days ago
Job description
Role & responsibilities
As a Data Engineer in our team, you will be responsible for assessing complex new data sources and
quickly turning these into business insights. You also will support the implementation and integration
of these new data sources into our Azure Data platform.
Responsibilities:
• You are detailed reviewing and analyzing structured, semi-structured and unstructured data
sources for quality, completeness, and business value.
• You design, architect, implement and test rapid prototypes that demonstrate value of the
data and present them to diverse audiences.
• You participate in early state design and feature definition activities.
• Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
• Responsible for creating reusable and scalable data pipelines.
• You are a Team-Player, collaborating with team members across multiple engineering teams
to support the integration of proven prototypes into core intelligence products.
• You have strong communication skills to effectively convey complex data insights to non-
technical stakeholders.
• You have an experience working collaboratively in cross-functional teams and manage
multiple projects simultaneously.
Skills:
• Advanced working knowledge and experience with relational and non-relational databases.
• Experience building and optimizing Big Data pipelines, architectures, and datasets.
• Strong analytic skills related to working with structured and unstructured datasets.
• Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
• Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark,
Python, Scala, SQL, or similar languages.
• Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event
Hub, Azure Synapse.
• Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes
Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
• Azure DevOps experience to deploy the data pipelines through CI/CD.
Qualifications and Experience:
• Minimum 5-7 years of practical experience as Data Engineer.
• Bachelors degree in computer science, software engineering, information technology, or a related
field.
• Azure cloud stack in-production experience.
Similar jobs
Data Engineer responsible for designing and implementing complex data infrastructure. Develop robust ETL processes and optimize data pipelines using technologies like Apache Spark and Airflow. · Architect and optimize scalable data storage solutions.Design and maintain efficient ...
1 month ago
Heidelberg Materials Trading is the international trading arm of Heidelberg Materials, one of the world's largest building materials companies, handling overseas dry‑bulk product exports and imports across global markets. · We are looking for a talented individual to join our IT ...
2 days ago
+Senior Data Engineer responsible for designing scalable data pipelines using PySpark. · +Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience). · 5 years of experience in big data technologies with a focus on Apache Spark and Python. · + ...
1 month ago
We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, · applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines. ...
4 weeks ago
+ We are seeking a highly skilled Senior Data Engineer with strong expertise in dimensional data modeling and modern data architecture patterns to design, build, and maintain scalable analytics-ready data platforms on AWS (and GCP). The ideal candidate has hands-on experience des ...
3 weeks ago
Design build and maintain data pipelines for batch near Real Time processing Develop manage data ingestion and transformation processes Ensure data quality reliability performance across data platforms Collaborate with data architects scientists analytics teams to support downstr ...
3 weeks ago
Data engineer responsible for designing, building and maintaining data pipelines, lakes and warehouses. Provides technical guidance on infrastructure for analytics and AI use cases. · ...
4 days ago
We are seeking a Senior Data Engineer with strong expertise in PySpark and Python, capable of building scalable, high-performance data pipelines. · ...
1 month ago
We are looking for a Data Engineer intern to participate in exciting projects covering the end-to-end data lifecycle - from raw data integrations with primary and third-party systems, through advanced data modelling, to state-of-the-art data visualisation and development of innov ...
1 month ago
This role involves working as a Senior Data Engineer in Dubai. · ...
4 days ago
We are looking for a Data Engineer to strengthen our Data Team at Wheely. · ResponsibilitiesEnhance Data team with architectural best practices and low-level optimizations · Cover up business units with feature requests / bugfixes / data quality issues · ...
1 month ago
We are seeking highly skilled Data Engineer with strong expertise in PySpark on Cloudera Data Platform (CDP) for designing · developing maintaining scalable data pipelines ensuring high data quality performance availability across organisation. · Design develop maintain scalabl ...
4 days ago
We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · ...
1 week ago
Data Engineer/Pyspark position in Dubai UAE with experience level of 7 to 9 Years. · ...
3 weeks ago
A reputable enterprise organisation based in the UAE are looking to add a highly skilled Data AI Engineer on a full time basis. · ...
3 weeks ago
The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data platforms that support analytics, reporting, and decision-making across the business. · ...
2 weeks ago
As a Data Engineer you will be at the core of the company s data ecosystem ensuring the data infrastructure is efficient scalable and reliable. · ...
3 weeks ago
We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. · 3+ years of exper ...
1 month ago
We are looking for an experienced Data Engineer to design develop and optimize data pipelines ETL processes and data integration solutions. · Develop and Maintain Data Pipelines to process structured and unstructured data efficiently. · Implement ETL/ELT Workflows for batch and r ...
3 weeks ago
The Data Engineer plays a key role in maintaining the quality of data insights solutions and ensuring alignment with business objectives. · ...
1 month ago
The Binance Accelerator Program is a fixed-term program designed for Early Career Talent to experience life at Binance and understand the company's operations. · ...
1 week ago