Description
You will manage, optimize, and troubleshoot Apache Kafka ecosystems within a banking infrastructure environment.
Responsibilities
- Install, configure, and maintain Apache Kafka clusters to support real-time data processing.
- Monitor and tune clusters to ensure scalability and optimal performance.
- Develop and manage data pipelines to ensure seamless data flow across banking systems.
- Troubleshoot and resolve Kafka-related incidents to maintain high availability.
- Implement security best practices including encryption, authentication, and authorization.
- Execute cluster upgrades and patches to maintain secure and up-to-date environments.
Required Skills
- 8+ years of experience managing Kafka clusters in a production environment.
- Proficiency with Apache Kafka and ZooKeeper.
- Experience working in Linux environments.
- Strong scripting skills in Python and Bash.
- Experience with monitoring tools such as Prometheus and Grafana.
- Ability to diagnose and resolve complex distributed system issues.
- Any Graduate degree.
Preferred Skills
- Experience with cloud platforms including AWS, Azure, or Google Cloud.
- Experience with managed Kafka services such as Confluent Cloud.
- Proficiency with automation tools including Ansible and Terraform.
- Kafka certification or relevant IT certifications.