- Responsible for implementation andongoing administration of Hadoopinfrastructure.
- Responsible for Clustermaintenance, trouble shooting, Monitoring and followed properbackup & Recoverystrategies.
- Provisioning and managing the lifecycle of multiple clusters like EMR & EKS. Infrastructuremonitoring, logging & alerting withPrometheGrafana/Splunk.
- Performance tuning ofHadoop clusters and Hadoop workloads and capacity planning atapplication/queue level. Responsible for Memory management, Queueallocation, distribution experience in Hadoop/Cloud eraenvironments.
- Experience in Linux / Unix OSServices, Administration, Shell, awkscripting
- Strong knowledge of anyoneprogramming language Python/Scala/Java/R with Debuggingskills.
- Experience in Hadoop (Map Reduce, Hive,Pig, Spark, Kafka, HBase, HDFS, H-catalog, Zookeeper andOozie/Airflow)
- Experience in Hadoop security(Kerberos, Knox, TLS).
-
Hadoop Engineer
4 days ago
Dice Dubai, United Arab EmiratesRole responsibilities; · Responsible for implementation and ongoing administration of Hadoop infrastructure. · Responsible for Cluster maintenance, trouble shooting, Monitoring and followed proper backup & Recovery strategies. · Provisioning and managing the life cycle of multipl ...
-
Informatica Bdm Developer
1 day ago
Trivoli digital pvt Ltd Dubai, United Arab EmiratesBuilding and optimizing data pipelines architectures and data sets; both batch-oriented and real time using Informatica BDM from both relational & non relational DBs · - Design, develop and customize mappings/workflows for different types of loads using Informatica BDM · - Levera ...
-
Java Microservice Developer
1 day ago
Swedish technology Dubai, United Arab EmiratesJava Microservice Developer · Description Skill : Data Engineer · Role : T2 · - Should have Strong expertise of Extraction, Transformation and Loading (ETL) mechanism using Informatica Big Data Management 10. · 2. X and various Push down mode using Spark, Blaze and Hive execution ...
-
Data Architect
2 days ago
Almosafer Dubai, United Arab EmiratesWe are currently looking for a fast and enthusiastic Data Architect. You will be responsible for building and maintaining company's data warehouse by identifying structural and installation solutions. You will also be required to build and maintain data infrastructure to extract ...
-
Technical Product Manager
5 days ago
E-Global Trade & Finance Dubai, United Arab EmiratesE-Global Group · We are a leading back-office solution provider for Fintech companies specialising in brokerage-related solutions. We have been operational for over ten years and are continually innovating on a wide range of products and services that serve the financial industry ...
-
Demi Chef De Partie
6 days ago
Rixos Hotels Dubai, United Arab EmiratesAre you an aspiring AI/ML Engineer and want to be part of a great engineering team? · If so, we both can end our quest. We are looking for you and you will love becoming part of our family. · "Drucare is a growing Health-tech company with a history of developing innovative soluti ...
-
Senior Data Product Owner
4 days ago
Tandem Search Dubai, United Arab Emirates Full timeKey Responsibilities: · Data Management · Strong understanding of Treasury & Global Markets products e.g., FX, Interest Rates, Commodities, Funding/Investment, Fixed Income and Credit, and Islamic Products. · Work with the WB and SME business, operations, and support teams. Also ...
-
Sr Data Architect W2 Only
1 day ago
Insight Global Dubai, United Arab EmiratesMUST-HAVE SKILLS/EXPERIENCE: · Bachelor's or master's degree in Computer Science, Information Technology, or a related field · 8+ years of experience in technical roles with expertise in Software/Data Engineering, Development Tools, Data Applications Engineering · Proficiency in ...
-
Data Engineer Informatica BDM
1 day ago
Precision Hire Solution Dubai, United Arab EmiratesRole: Data Engineer · Skill: Informatica BDM 10.2.x ETL Big Data Hadoop ecosystem · Description: · Should have Strong expertise of Extraction Transformation and Loading (ETL) mechanism using Informatica Big Data Management 10.2.X and various Push down mode using Spark Blaze an ...
-
data migration
1 day ago
Duncan & Ross Dubai, United Arab Emirates8 years of experience in data engineering with a focus on data migration and integration projects. · Experience with CRM platforms (e.g. Dynamics CRM Salesforce) and CRMtoCRM migration processes. · Strong proficiency in data lake architecture technologies and best practices (e.g. ...
-
Assistant Manager
3 days ago
Kenvue Dubai, United Arab EmiratesRequired Qualifications · Bachelor of Science or Bachelor of Engineering at a minimum. · A combination of business focus, strong analytical and problem-solving skills, and programming knowledge to be able to quickly cycle hypothesis through the discovery phase of a project · Adva ...
-
Sr Applied Scientist
4 days ago
myGwork - LGBTQ+ Business Community Dubai, United Arab EmiratesWhat will you do? · Quantize, prune, distill, finetune Gen AI models to optimize for edge platforms · Fundamentally understand Amazon's underlying Neural Edge Engine to invent optimization techniques · Analyze deep learning workloads and provide guidance to map them to Amazon's N ...
-
Data Engineer
1 day ago
NTT Ltd Dubai, United Arab EmiratesAcademic qualifications and certifications: · Relevant qualification (Bachelor's in computer science, information technology or applied math) · Relevant certification, e.g. Certified Data engineer, Certified Professional, etc) · Experience required: · Proven experience working wi ...
-
AI Engineer
1 day ago
NTT Ltd Dubai, United Arab EmiratesAcademic Qualifications and Certifications: · Degree in Data Science, Business Analytics, Mathematics, Economics, Statistics, Engineering, Computer Science, Computer Engineering or another quantitative field (preferably a bachelor's degree or equivalent) · Relevant programming qu ...
-
Data ScienceMachine Learning Engineer
3 days ago
PROCTER & GAMBLE Dubai, United Arab EmiratesJob Qualifications · Bachelors Degree in Computer Science or related field · Strong background in statistics, mathematics, and computer science, with a focus on machine learning and data science. · Proficiency in programming languages such as Python or R, and experience with rele ...
-
Sr Applied Scientist
4 days ago
myGwork - LGBTQ+ Business Community Dubai, United Arab EmiratesWhat will you do? · Quantize, prune, distill, finetuneGen AI models to optimize for edgeplatforms · Fundamentally understandAmazon's underlying Neural Edge Engine to inventoptimization techniques · Analyze deep learningworkloads and provide guidance to map them to Amazon'sNeural ...
-
Business Intelligence Engineer
6 days ago
Amazon UAE Dubai, United Arab EmiratesWork closely with multiplebusiness teams to understand their challenges and providedata/analysis for better decision making. This will require datagathering and manipulation, synthesis and modeling, problemsolving, and communication of insights andrecommendations. · Learn and und ...
-
Business Intelligence Engineer
3 days ago
Amazon UAE Dubai, United Arab EmiratesWork closely with multiple business teams to understand their challenges and provide data/analysis for better decision making. This will require data gathering and manipulation, synthesis and modeling, problem solving, and communication of insights and recommendations. · Learn an ...
-
Data Scientist
4 days ago
myGwork - LGBTQ+ Business Community Dubai, United Arab EmiratesKey job responsibilities · Analyze, model and interpret data for Amazon warehouse operational performance · Data analysis, modeling, network flow prediction using Excel, Pivot tables, VBA, Tableau, SQL (Amazon Redshift), R, Python · Predictive analysis using Machine Learning mode ...
-
Lead Data Engineer Finance Tech
20 hours ago
SimplyApply Dubai, United Arab EmiratesWhat You'll Do · Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies · Work with a team of developers with deep experience in machine learning, distributed microservices, and ...
Hadoop Engineer - Dubai, United Arab Emirates - Dice
Description
Role responsibilities;
The idealcandidate will have experience with the following;