Description

You will manage, monitor, and optimize Apache Kafka clusters for production and non-production environments.

This role is hybrid.

Responsibilities

• Install, configure, and maintain Kafka clusters, topics, partitions, and replication policies.
• Monitor cluster health and performance using Prometheus, Grafana, or ELK stack to ensure high throughput and low latency.
• Implement data security including SASL authentication, ACL authorization, and SSL/TLS encryption.
• Troubleshoot broker failures, consumer lag, and data inconsistencies while performing upgrades and patching with minimal downtime.
• Automate routine tasks using Bash or Python and maintain documentation for configurations and disaster recovery.

Required Skills

• 2–5 years of experience with Apache Kafka administration and support.
• Strong understanding of distributed systems, messaging architectures, and streaming concepts.
• Hands-on experience with Kafka ecosystem tools including Zookeeper/KRaft, Kafka Connect, and Kafka Streams.
• Proficiency in Linux/Unix systems administration.
• Knowledge of monitoring tools such as Prometheus, Grafana, or ELK stack.
• Scripting skills in Bash, Python, or similar languages.
• Familiarity with cloud platforms like AWS, Azure, or GCP.
• Bachelor’s degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Experience with containerization and orchestration tools (Docker, Kubernetes).
• Understanding of data pipelines, ETL processes, and streaming architectures.

Key Skills

Education

Bachelor's degree