Description

You will design, implement, and maintain highly available Kafka clusters in production.

This role is on-site.

Responsibilities

• Design and maintain high-availability Kafka clusters, performing upgrades and patching with minimal downtime.
• Monitor cluster health and performance using Prometheus and Grafana, troubleshooting production incidents.
• Manage Kafka Connect, Kafka Streams, and MirrorMaker to optimize data pipeline throughput and reliability.
• Develop automation scripts in Shell and Python to streamline operational tasks and reduce manual intervention.

Required Skills

• 5+ years of professional experience, preferably in the Finance Domain.
• Expertise administering and tuning Apache Kafka clusters (2.x or 3.x) in production.
• Strong proficiency with Linux systems (RHEL, Ubuntu), including kernel tuning and filesystem management.
• Deep knowledge of the Kafka ecosystem: ZooKeeper, Schema Registry, MirrorMaker, and KRaft.
• Scripting and automation skills in Shell and Python.
• Experience managing infrastructure using IaC and configuration management tools (e.g., Ansible, Terraform).
• Familiarity with container orchestration platforms like Docker and Kubernetes.
• Understanding of security protocols including SSL/TLS, SASL, and RBAC for Kafka.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• Experience with high-throughput data streaming architectures.

Key Skills

Education

Bachelor's degree