Description

You will manage Kafka infrastructure and data ingestion pipelines in a hybrid on-premises and cloud environment.

Responsibilities

• Build and manage Kafka topics, brokers, and ZooKeeper instances.
• Configure real-time data ingestion from source to sink using Kafka connectors for CRUD operations.
• Deploy Kafka nodes as Pods or Docker containers on AKS or OpenShift managed Kubernetes platforms.
• Implement error handling, message retry/replay logic, and error topic/queue patterns.
• Optimize Kafka deployments for throughput, latency, durability, and availability.

Required Skills

• 6-8+ years of experience with scripting languages.
• Hands-on experience setting up schedulers and real-time data ingestion.
• Experience streaming on-premises data for cloud analytics using Confluent Kafka.
• Proven ability to set up Confluent Schema Registry.
• Experience deploying Kafka on Kubernetes (AKS or OpenShift).
• Proficiency in setting up Kafka monitoring dashboards using Grafana and Prometheus.
• Kafka Topics, Cloud Analytics, and Kafka connectors.

Preferred Skills

• Experience optimizing high-throughput Kafka clusters.

Key Skills

Education

Any Graduate