Description

You will design, manage, and scale Kafka clusters and GCP infrastructure within distributed, event-driven architectures.

Responsibilities

• Install, configure, and maintain Kafka clusters across development, testing, and production environments.
• Monitor cluster health and performance using Prometheus and Grafana to diagnose broker, topic, and partition issues.
• Implement security protocols including SSL/TLS encryption, Kerberos authentication, and access control policies.
• Automate cluster provisioning, monitoring, and maintenance tasks using Terraform and shell scripting.
• Develop disaster recovery plans and test backup/restore procedures to ensure data integrity.
• Communicate technical designs and proof-of-concept solutions to clients and stakeholders.

Required Skills

• 15+ years of experience in infrastructure.
• 5+ years of experience as a Kafka Administrator managing Kafka clusters.
• 5+ years of experience as a GCP Cloud Architect.
• Deep understanding of distributed systems, data streaming, and event-driven architectures.
• Proficiency with Terraform for infrastructure as code.
• Strong experience with Linux/Unix operating systems and shell scripting.
• Knowledge of network security principles and practices.
• Experience with Kafka component management, including ZooKeeper.
• Ability to perform capacity planning and optimize Kafka configurations for scalability.

Preferred Skills

• Proficiency with containerization technologies including Docker and Kubernetes.
• Experience with GitLab CI/CD pipelines.

Key Skills

Education

Any Graduate