Description

Manage Kafka clusters and ensure real-time data pipeline reliability.

This role is on-site.

Responsibilities

• Install, configure, and manage Kafka clusters across on-prem and cloud environments.
• Monitor cluster health, performance, and resource utilization using Prometheus, Grafana, and Confluent Control Center.
• Implement security controls including TLS, Kerberos, and RBAC for authentication and authorization.
• Troubleshoot issues with brokers, producers, and consumers to maintain high availability.
• Automate operational tasks and support upgrades, patching, and disaster recovery planning.

Required Skills

• 10+ years of experience in software engineering.
• 3–5 years of dedicated experience in Kafka administration within enterprise environments.
• Deep understanding of Kafka internals, Zookeeper, and Kafka Connect.
• Experience with Kafka in cloud-native environments such as AWS MSK, Confluent Cloud, or self-managed on Kubernetes.
• Proficiency in Linux administration and shell scripting.
• Strong background in monitoring, logging, and CI/CD pipelines.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Experience collaborating with platform architects to support complex real-time data use cases.
• Familiarity with infrastructure-as-code tools for automation.

Key Skills

Education

Bachelor's or Master's degrees