Description

Manage Kafka clusters across on-prem and cloud environments, ensuring high availability, security, and performance for real-time data use cases.

This role is on-site.

Responsibilities

• Install, configure, and maintain Kafka clusters, topics, partitions, and replication policies.
• Monitor cluster health, resource utilization, and capacity using Prometheus, Grafana, and Confluent Control Center.
• Implement and enforce security controls including TLS, Kerberos, RBAC, and encryption.
• Troubleshoot broker, producer, and consumer issues while supporting upgrades, patching, and disaster recovery.
• Automate operational tasks using shell scripting and infrastructure-as-code tools.

Required Skills

• 10+ years of software engineering experience with 3–5 years in Kafka administration.
• Deep understanding of Kafka internals, Zookeeper, and Kafka Connect.
• Experience with cloud-native Kafka deployments (AWS MSK, Confluent Cloud) or self-managed on Kubernetes.
• Proficiency in Linux and shell scripting for automation and troubleshooting.
• Strong monitoring and logging capabilities using Prometheus and Grafana.
• Familiarity with CI/CD pipelines and DevOps practices.

Preferred Skills

• Experience collaborating with platform architects to support complex real-time data architectures.
• Background in infrastructure-as-code for automated cluster provisioning.

Key Skills

Education

Any Graduate