Description

Job Description:
The ideal candidate should have strong hands-on expertise in Apache Kafka cluster administration, including managing brokers, topics, partitions, and working with Zookeeper or KRaft-based architectures. Solid experience with Linux/Unix systems and scripting using Shell or Python is essential.

Candidates must be proficient in monitoring and observability tools such as Prometheus, Grafana, and Splunk, with the ability to optimize cluster performance, throughput, and latency. Strong knowledge of Kafka security (SSL/TLS, SASL, ACLs) and real-time data streaming systems is required.

The role involves installing and managing Kafka clusters, troubleshooting performance and connectivity issues, implementing monitoring and alerting, automating routine tasks, and ensuring high availability, scalability, and disaster recovery readiness. Collaboration with development teams for integration and maintaining detailed documentation is also critical.

Technology Stack
·    Apache Kafka (Cluster Administration)
·    Kafka Brokers, Topics, Partitions
·    Zookeeper / KRaft (Kafka Architecture)
·    Linux/Unix Systems
·    Monitoring Tools (Prometheus, Grafana, Splunk)
·    Scripting (Shell, Python)
·    Security (SSL/TLS, SASL, ACLs)
·    Data Streaming & Integration Systems

Key Responsibilities
·    Install, configure, and manage Kafka clusters ensuring high availability and fault tolerance
·    Monitor cluster performance, identify bottlenecks, and optimize throughput & latency
·    Implement and manage Kafka security (authentication, authorization, encryption)
·    Set up monitoring & alerting systems for proactive issue detection
·    Troubleshoot Kafka issues (performance, connectivity, data flow)
·    Collaborate with development teams for Kafka integrations and real-time data streaming
·    Maintain documentation for Kafka configurations, processes, and procedures
·    Automate routine tasks using scripting tools
·    Perform capacity planning and ensure scalability of Kafka infrastructure
·    Support disaster recovery strategies and ensure business continuity

Key Skills

Education

Any Graduate