Description

You will manage, scale, and secure Kafka clusters across development, testing, and production environments.

Responsibilities

• Install, configure, and maintain Kafka clusters and ZooKeeper components.
• Monitor cluster health and performance using Prometheus, Grafana, or similar tools to resolve broker, topic, and partition issues.
• Implement security protocols including SSL/TLS encryption, Kerberos authentication, and access control policies.
• Execute capacity planning and optimize configurations for performance and scalability.
• Develop disaster recovery plans and maintain backup and restore procedures.
• Automate routine tasks like provisioning and maintenance using Ansible, Puppet, or custom shell scripts.
• Collaborate with developers on usage patterns and provide technical documentation for operational procedures.

Required Skills

• 10+ years of experience in infrastructure.
• 3+ years of experience as a Kafka Administrator or managing Kafka clusters.
• Deep understanding of distributed systems, data streaming, and event-driven architectures.
• Proficiency with Linux/Unix operating systems and shell scripting.
• Experience with Kafka cluster upgrades, patching, and maintenance.
• Hands-on experience with CI/CD pipelines for Kafka deployments.
• Ability to provide on-call support for Kafka-related issues.

Preferred Skills

• Experience with cloud platforms including AWS, Azure, or GCP.
• Familiarity with containerization technologies such as Docker and Kubernetes.

Key Skills

Education

Any Graduate