Description

You will architect, build, and support Kafka clusters to enable data pipeline solutions.

Responsibilities

• Architect and build Kafka clusters using Infrastructure-as-Code (IaC) best practices.
• Consult with teams on leveraging Kafka within their existing pipelines.
• Partner with Splunk teams to route traffic through Kafka using open-source agents and collectors deployed via Chef.
• Automate operational processes and manage CI/CD pipelines.
• Remediate Kafka health issues and create monitoring dashboards and alerts.
• Perform PoCs on new components to enhance Kafka offerings.

Required Skills

• 3+ years of experience with Kafka clustering and administration.
• 3+ years of experience building and supporting Kafka clusters using IaC.
• Experience with Linux/Unix and system management.
• Proficiency with IaC tools such as Chef, Ansible, Jenkins, or Artifactory.
• Practical understanding of Git workflows and CI/CD concepts.
• Experience working within Agile or Lean methodologies.
• Strong technical acumen and analytical skills.
• Strong verbal and written communication skills.

Preferred Skills

• Experience with Splunk, Elastic, Kibana, or Grafana.
• Knowledge of log collection agents like Open-Telemetry, Fluent Bit, FluentD, Beats, or Logstash.
• Experience with Kubernetes, Docker, or Kafka-Connect.
• Knowledge of AWS, Azure, or Streaming Analytics.

Key Skills

Education

Any Gradute