Description

Design, deploy, and maintain highly available Kafka clusters and Linux infrastructure for real-time data platforms.

This role is on-site.

Responsibilities

• Design, implement, and maintain production Kafka clusters, including upgrades, patching, and security protocols.
• Monitor cluster health and resolve incidents such as broker outages and replication lag using Prometheus and Grafana.
• Develop Kafka topics, partitions, ACLs, and schema registry configurations to optimize throughput and reliability.
• Automate provisioning, configuration, and monitoring using Infrastructure as Code tools like Ansible and Terraform.
• Build custom tooling and dashboards for producers and consumers, and manage data pipelines with Kafka Connect and Mirror Maker.

Required Skills

• 5+ years of Kafka administration experience, ideally with Confluent Kafka.
• Proficiency in Linux (RHEL, Ubuntu), Python, and Bash scripting.
• Hands-on experience with Kafka monitoring tools and security protocols.
• Experience deploying Kafka clusters on OpenShift/Kubernetes using Helm charts and Docker images.
• Knowledge of Kafka ecosystem components: ZooKeeper, KRaft, Schema Registry, and MirrorMaker.
• Ability to perform root cause analysis and manage disaster recovery setups.
• Experience with data ingestion and streaming pipelines to sources like Solr.

Preferred Skills

• 10+ years of total professional experience in infrastructure or platform engineering.
• Experience with Java and Spring Boot for building custom Kafka tooling.

Key Skills

Education

Any Graduate