Description

Lead the management, maintenance, and monitoring of Apache Kafka clusters to ensure high availability, performance, and security.

Responsibilities

• Install, configure, and maintain Kafka clusters and ZooKeeper across development, testing, and production environments.
• Monitor cluster health and performance using Prometheus, Grafana, or proprietary tools to diagnose issues with brokers, topics, and consumers.
• Implement security protocols including SSL/TLS encryption, Kerberos authentication, and access control policies.
• Execute capacity planning and optimize Kafka configurations for scalability and reliability.
• Develop disaster recovery plans, backup procedures, and automation scripts for cluster provisioning and maintenance.

Required Skills

• 10+ years of experience in infrastructure.
• 3+ years of experience specifically as a Kafka Administrator managing Kafka clusters.
• Deep understanding of distributed systems, data streaming, and event-driven architectures.
• Proficiency with Linux/Unix operating systems and shell scripting.
• Hands-on experience with Apache Kafka.
• Experience with automation tools like Ansible, Puppet, or custom scripting.
• Ability to implement CI/CD pipelines for Kafka-related deployments.

Preferred Skills

• Experience with cloud platforms including AWS, Azure, or GCP.
• Familiarity with containerization technologies such as Docker and Kubernetes.

Key Skills

Education

Any Graduate