Description
Manage and optimize Kafka infrastructure and data streaming pipelines on-premises and in the cloud.
This role is on-site.
Responsibilities
- Provision and manage Kafka topics, brokers, and ZooKeeper instances.
- Configure real-time data ingestion using Kafka connectors for CRUD operations.
- Deploy Kafka nodes as PODs or Docker containers on AKS and OpenShift.
- Implement error handling, message retry, and replay logic using error topics and queues.
- Optimize Kafka deployments for throughput, latency, durability, and availability.
Required Skills
- 5-8 years of experience as a Kafka Administrator.
- Proficiency in Python for scripting and automation.
- Strong Shell Scripting skills.
- Hands-on experience with Docker and Kubernetes platforms (AKS, OpenShift).
- Experience setting up Confluent Schema Registry.
- Knowledge of Prometheus and Grafana for monitoring dashboard setup.
- Any Graduate degree.