Description

You will build and maintain Kafka-based data infrastructure, managing clusters across production and non-production environments.

This role is on-site.

Responsibilities

• Manage and configure Kafka clusters using ZooKeeper or Kraft, including implementing various connectors.
• Develop and maintain ksqlDB streams and tables for data processing.
• Operate Kafka infrastructure on Kubernetes and troubleshoot related issues.
• Implement CI/CD pipelines using GitLab and automate infrastructure management via Terraform.
• Monitor Kafka environments using DataDog and adhere to incident/change management processes.

Required Skills

• 5+ years of professional experience managing Kafka clusters in production settings.
• Strong practical exposure to Kubernetes and Docker.
• Hands-on expertise implementing CI/CD pipelines specifically with GitLab.
• Proficiency in managing core AWS services (Security Groups, Load Balancers, Route 53, S3, EC2, ECR).
• Experience writing and managing YAML configuration files.
• Ability to automate infrastructure management using Terraform.
• Familiarity monitoring Kafka environments using tools like DataDog.

Preferred Skills

• Experience with Kafka cluster configuration using Kraft mode.
• Background in managing infrastructure via GitLab.

Key Skills

Education

Any Graduate