Description

This role involves building, managing, and optimizing Kafka-based data pipelines.

Responsibilities

• Develop Kafka producers and consumers, implementing stream processing logic.
• Manage Kafka clusters, covering setup, configuration, monitoring, and troubleshooting.
• Integrate Kafka with external systems using Kafka Connect.
• Design and build real-time analytics applications using Kafka Streams and KSQLDB.

Required Skills

• 5+ years of hands-on experience with Apache Kafka and Confluent Kafka in production.
• Proficiency in Java, Python, or Scala for Kafka development.
• Expertise using Confluent Control Center for cluster management and optimization.
• Strong knowledge of Kafka internals: brokers, topics, partitions, and offsets.
• Experience with Kafka Streams for scalable stream processing.
• Experience with KSQLDB for real-time topic analytics.
• Familiarity with CI/CD Pipelines and automation tools.
• Knowledge of monitoring tools like Prometheus and Grafana.
• Understanding of distributed systems and event-driven design patterns.

Key Skills

Education

Any Graduate