Description

You will build, manage, and optimize Kafka-based data pipelines in Abu Dhabi.

This role is on-site.

Responsibilities

• Develop Kafka producers and consumers with stream processing logic.
• Manage Kafka clusters including setup, configuration, monitoring, and troubleshooting.
• Integrate Kafka with external systems using Kafka Connect.
• Design real-time analytics applications using Kafka Streams and KSQLDB.

Required Skills

• 5+ years of hands-on experience with Apache Kafka and Confluent Kafka in production.
• Proficiency in Java, Python, or Scala for Kafka development.
• Expertise using Confluent Control Center for cluster management and optimization.
• Strong knowledge of Kafka internals: brokers, topics, partitions, and offsets.
• Experience with Kafka Streams for scalable stream processing.
• Experience with KSQLDB for real-time topic analytics.
• Familiarity with CI/CD Pipelines and automation tools.
• Knowledge of monitoring tools like Prometheus and Grafana.

Preferred Skills

• Understanding of distributed systems and event-driven design patterns.

Key Skills

Education

Any Graduate