Description

You will design, deploy, and maintain Apache Kafka clusters and Confluent Platform environments to support real-time data ingestion and streaming analytics.

This role is on-site.

Responsibilities

• Deploy and manage Kafka nodes as Pods or Docker containers on AKS/OpenShift managed Kubernetes platforms.
• Configure Confluent Schema Registry and optimize Kafka deployments for throughput, latency, durability, and availability.
• Implement real-time data ingestion pipelines using Kafka connectors with full CRUD support and error handling mechanisms like retry/replay queues.
• Set up and maintain monitoring dashboards using Grafana and Prometheus to track cluster health and performance metrics.
• Script automation tasks and manage scheduler configurations using Python.

Required Skills

• 8+ years of hands-on experience as a Kafka Administrator.
• Deep expertise in creating Kafka topics/brokers and managing Zookeeper instances.
• Proficiency with Confluent Kafka for streaming on-premises data to cloud analytics.
• Strong Python scripting skills for automation and tooling.
• Experience deploying Kafka on AKS or OpenShift Kubernetes platforms.
• Ability to configure error topics and handle upstream/downstream system failures.

Preferred Skills

• Experience with Confluent Schema Registry optimization.
• Familiarity with Grafana and Prometheus for Kafka monitoring.

Key Skills

Education

Any Graduate