You will design, implement, and support real-time data streaming platforms in a large-scale enterprise environment.
This role is on-site.
Responsibilities
Install, configure, and manage Apache Kafka and Confluent Platform environments, including cluster setup, topic configuration, partitioning, and replication strategies.
Design and implement high-throughput, fault-tolerant data streaming solutions using event-driven architecture principles.
Monitor and optimize Kafka cluster performance, availability, and scalability; perform root cause analysis on production issues.
Implement security (SSL, SASL, ACLs) and governance best practices across Kafka brokers and Confluent components.
Develop automation scripts for environment provisioning and monitoring; support production environments including on-call rotation.
Required Skills
5+ years of experience in distributed systems or middleware support.
Strong hands-on experience with Apache Kafka and Confluent Platform setup, configuration, and administration.
Deep understanding of Kafka architecture: brokers, topics, partitions, consumers, and producers.
Proficiency in Linux/Unix environments with scripting capabilities in Shell and Python.
Experience with monitoring tools such as Prometheus, Grafana, or Confluent Control Center.
Strong troubleshooting skills for production environments and familiarity with messaging systems.
Preferred Skills
Exposure to cloud platforms (AWS, Azure, GCP) and containerization tools (Docker, Kubernetes).
Experience with Kafka Connect, Schema Registry, ksqlDB, or CI/CD pipelines.