Description

You will design and manage distributed data streaming architectures and Kafka clusters to ensure high availability and scalability.

Responsibilities

• Design, deploy, and manage Apache Kafka clusters, including broker setup, topic management, and partitioning strategies.
• Develop real-time data streaming solutions using Kafka Streams and related ecosystem tools.
• Optimize Kafka performance by tuning brokers, topics, and configurations.
• Implement security measures including encryption, authentication, and authorization for data integrity.
• Monitor cluster health and resolve issues related to performance, connectivity, and data processing using Prometheus, Grafana, and ELK stack.

Required Skills

• 5+ years of experience in distributed systems and event-driven architectures.
• Core Java and Spring Boot proficiency.
• Deep expertise in Apache Kafka and Kafka Streams.
• Proficiency with Linux/Unix systems and scripting in Bash or Python.
• Hands-on experience with Docker, Kubernetes, and Terraform.
• Familiarity with CI/CD pipelines and DevOps practices.
• Knowledge of data serialization formats including Avro, Protobuf, and JSON.

Preferred Skills

• Hands-on experience with cloud platforms including AWS, Azure, or Google Cloud.
• Experience with KSQL and Kafka Manager.

Key Skills

Education

Any Graduate