Description

You will manage and scale Kafka infrastructure and supporting CI/CD pipelines.

Responsibilities

• Architect, build, and support Kafka clusters using Infrastructure as Code (IaC).
• Consult with engineering teams on leveraging Kafka within their data pipelines.
• Partner with Splunk teams to route traffic through Kafka using open-source agents and collectors deployed via Chef.
• Automate operational processes and manage continuous improvement within CI/CD pipelines.
• Remediate Kafka health issues and create monitoring dashboards and alerts.
• Perform Proof of Concepts (PoC) on new components to enhance Kafka offerings.

Required Skills

• 5+ years of experience in DevOps or infrastructure roles.
• Hands-on experience with Kafka cluster management and troubleshooting.
• Proficiency with Splunk for data routing and observability.
• Experience with Ansible for configuration management.
• Working knowledge of Grafana for monitoring and dashboarding.
• Experience implementing Infrastructure as Code (IaC).
• Practical knowledge of Chef for deployment.
• Experience managing CI/CD pipelines.
• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate