Confluent Kafka Engineer - Abu Dhabi Emirate, United Arab Emirates - Talent Arabia

    Talent Arabia
    Talent Arabia Abu Dhabi Emirate, United Arab Emirates

    2 days ago

    Description

    We have an urgent requirement for Confluent Kafka Engineer for one of our banking client in Abu Dhabi, UAE

    Strong experience in Confluent and Kafka is MUST for this role

    Job Summary:

    We are seeking a highly skilled Confluent Kafka Engineer to join our dynamic team. The ideal candidate will be responsible for the development, User Acceptance Testing (UAT), and production support of our Confluent Kafka-based systems. This role requires deep expertise in Kafka architecture, including Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect. The engineer will collaborate closely with cross-functional teams to ensure the smooth operation of our data streaming services and provide support across various environments.

    Key Responsibilities:

    Development:

    ·       Design, develop, and implement Kafka-based solutions to meet business requirements, utilizing Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.

    ·       Write and maintain high-quality code for Kafka producers, consumers, and stream processing applications.

    ·       Develop and manage Kafka connectors for seamless integration with external systems, ensuring data consistency and reliability.

    ·       Utilize Kafka Streams for real-time processing of streaming data, transforming and enriching data as it flows through the pipeline.

    ·       Employ KSQLDB for stream processing tasks, including real-time analytics and transformations.

    ·       Collaborate with data engineers, software developers, and DevOps teams to integrate Kafka solutions with existing systems.

    ·       Ensure all Kafka-based solutions are scalable, secure, and optimized for performance.

    User Acceptance Testing (UAT):

    ·       Develop and execute UAT plans to validate Kafka solutions, including components such as Kafka Streams, KSQLDB, and Kafka Connect, before deployment to production.

    ·       Work closely with QA teams to identify and resolve defects during the UAT phase.

    ·       Ensure all UAT activities comply with the organization's standards and best practices.

    ·       Provide detailed reports on UAT outcomes and work with developers to implement necessary fixes.

    Production Support:

    ·       Monitor and maintain Kafka clusters, including components like Confluent Control Center, to ensure high availability and reliability of data streaming services.

    ·       Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity, including issues specific to Kafka Streams, KSQLDB, and Kafka Connect.

    ·       Perform routine maintenance tasks such as patching, upgrades, and backups for Kafka clusters and associated components.

    ·       Implement monitoring solutions to proactively identify and mitigate potential production issues, leveraging Confluent Control Center for comprehensive cluster visibility.

    ·       Provide 24/7 support for production systems, including participation in on-call rotation.

    Qualifications:

    Education: Bachelor's degree in Computer Science, Information Technology, or a related field.

    Experience:

    · years of hands-on experience with Apache Kafka and Confluent Kafka in a production environment, including experience with Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.

    ·       Proven experience in Kafka development, including producer and consumer API, stream processing, and connector development.

    ·       Experience with Kafka cluster management, including setup, configuration, monitoring, and troubleshooting.

    ·       Familiarity with distributed systems, microservices architecture, and event-driven design patterns.

    ·       Experience with cloud platforms (e.g., AWS, Azure) and containerization (Kubernetes) is a plus.

    Technical Skills:

    ·       Proficiency in programming languages such as Java, Python, or Scala.

    ·       Strong knowledge of Kafka internals, including brokers, zookeepers, topics, partitions, and offsets.

    ·       Experience with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks (e.g., Log4j, ELK Stack).

    ·       Proficiency in using Confluent Control Center for monitoring, managing, and optimizing Kafka clusters.

    ·       Expertise in Kafka Streams for building scalable, fault-tolerant stream processing applications.

    ·       Experience with KSQLDB for real-time processing and analytics on Kafka topics.

    ·       Strong understanding of Kafka Connect for integrating Kafka with external data sources and sinks.

    ·       Understanding of networking, security, and compliance aspects related to Kafka.

    ·       Familiarity with CI/CD pipelines and automation tools (e.g., Jenkins, GitLab CI). 

  • Confluent Kafka Engineer-Bank

    1 week ago

    Talent Arabia Abu Dhabi Emirate, United Arab Emirates

    We are seeking a highly skilled Confluent Kafka Engineer to join our dynamic team. The ideal candidate will be responsible for the development, User Acceptance Testing (UAT), and production support of our Confluent Kafka-based systems. · This role requires deep expertise in Kafka ...

  • Confluent Kafka Engineer-Bank

    3 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We are seeking a highly skilled Confluent Kafka Engineer to join our dynamic team. · Bachelor's degree in Computer Science, Information Technology, or a related field. · ...

  • Confluent Kafka Engineer-Bank

    3 weeks ago

    Only for registered members Abu Dhabi

    We are seeking a highly skilled Confluent Kafka Engineer to join our dynamic team. The ideal candidate will be responsible for the development, User Acceptance Testing (UAT), and production support of our Confluent Kafka-based systems. · ...

  • Staff Engineer

    3 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    In a changing and evolving world, challenges are ever more unique and complex. Nagarro helps to transform, adapt, and build new ways into the future through a forward-thinking, agile, and caring mindset. · ...

  • Application Support

    1 week ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We're hiring an experienced Senior Support Engineer to join our team in Abu Dhabi, UAE. · Provide L2/L3 support for .NET Core and Angular-based applications. · Investigate and resolve production issues related to application logic, data, performance, and integrations. · ...

  • Senior Full Stack Engineer – .NET Core with React and Microservices

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We are looking for an experienced Full Stack .NET Developer who is passionate about designing and developing high-quality, scalable, and secure applications. · Strong experience in .NET Core & ASP.NET Core MVC – expert-level backend development and API design is MUST for this rol ...

  • Backend Engineer

    3 days ago

    Only for registered members Abu Dhabi

    We are seeking a highly skilled Backend Engineer to design, build and maintain the core infrastructure for AI-powered applications. · You will work closely with machine learning engineers data scientists and frontend developers to create scalable secure and efficient backend syst ...

  • Data Engineer

    2 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Candidates with a Master of Science in Data Analytics or bachelor's degree in computer science/engineering are required for this position. · ...

  • Backend Engineer

    2 weeks ago

    Only for registered members Abu Dhabi

    Develop and maintain robust backend systems ensuring high performance and reliability. Develop RESTful or GraphQL APIs to connect frontend interfaces with server-side logic and third-party services. · ...

  • Job Opening/Hiring for Solution Architect

    2 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    We are looking for an experienced Solution Architect to lead the architecture design and delivery of advanced Data and AI solutions for enterprise clients. · Design end-to-end data and AI architectures across ingestion transformation storage analytics and ML layers. · Build scala ...

  • Senior Back End Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    As a Full Stack/Backend Engineer at AppliedAI you will design and develop server-side logic APIs and backend systems using Python microservices. · ...

  • Backend Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Develops and maintains server-side logic databases and APIs ensuring scalability security and efficiency for analytical and AI powered applications. · ...

  • Senior Backend Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Design, develop and maintain high-quality backend services using Java and Spring Boot. · ...

  • Senior Site Reliability Engineer

    1 month ago

    Only for registered members Abu Dhabi

    We re looking for a Senior Site Reliability Engineer to join our team in Abu Dhabi. As a key member of our engineering organization you will contribute to the design build and operation of ZEDEDA s global cloud and on premise infrastructure. · ...

  • Data Engineer UAE Nationals

    4 days ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Job summaryAbout AI71: · AI71 is an industry leader in artificial intelligence, · delivering innovative solutions that empower developers, · businesses and governments to solve complex challenges. · Ai71 builds secure enterprise-ready applications powered by cutting-edge technolo ...

  • Senior Devops Engineer- onsite

    3 weeks ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    A Senior Devops Engineer oversees the code releases combining an understanding of both engineering and coding. They understand the software development lifecycle and have a clear understanding of various automation tools for developing digital pipelines (CI/ CD pipelines). · ...

  • Azure Devops Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    Azure DevOps Engineer oversees code releases combining engineering and coding understanding. They create implement systems software analyze data to improve existing ones increasing productivity in the workplace. · Perform site deployments environment debugging · Implementing deve ...

  • Data Engineer

    1 month ago

    Only for registered members Abu Dhabi, Abu Dhabi Emirate

    The Data Engineer is responsible for designing, implementing and optimising data pipelines and infrastructure to support cutting-edge AI systems. · Design develop and maintain scalable reliable data pipelines to ingest transform and load diverse datasets from various sources incl ...

  • Data Engineer

    1 week ago

    Institute of Foundation Models Abu Dhabi

    Job summary · Data Engineer specializing in Natural Language Processing (NLP) and large-scale data processing will gather curate and prepare high-quality datasets to support cutting-edge NLP research. · ResponsibilitiesRapidly collect curate and preprocess datasets based on detai ...

  • Data Engineer

    3 weeks ago

    Only for registered members Abu Dhabi

    We are looking for a Data Engineer who can build scalable data pipelines while also developing intelligent AI solutions using Azure Agent Foundry, OpenAI services, LangChain, Databricks, and modern cloud architectures. · ...

Jobs
>
Abu Dhabi