Description

You will design, implement, and manage Kafka-based solutions and distributed systems across multiple environments.

Responsibilities

• Identify and rectify Kafka messaging issues within required timeframes.
• Design and deliver scalable Kafka-based data pipelines considering throughput, fault tolerance, and latency.
• Administer distributed Kafka clusters across DEV, QA, UAT, and PROD environments.
• Provide technical direction, guidance, and code reviews to other engineers.
• Implement and debug microservices and subsystems following an automate-first philosophy.

Required Skills

• 5+ years of experience with Kafka concepts including producers, consumers, topics, partitions, brokers, and replication.
• Proficiency in Java or Scala, with potential use of Python.
• Experience with Kafka Streams for real-time data processing.
• Knowledge of data serialization formats such as JSON, Avro, and Protobuf.
• Ability to manage data schema evolution.
• Experience monitoring Kafka cluster health and troubleshooting performance bottlenecks.
• Hands-on experience with AWS, Azure, or GCP.
• Strong understanding of distributed systems concepts.
• Ability to work within Agile methodologies.

Key Skills

Education

Any Graduate