Description

You will manage and maintain Kafka data infrastructure, including pipeline design, cluster optimization, and automation.

This role is on-site.

Responsibilities

• Design, develop, and manage Kafka-based data pipelines.
• Monitor and optimize Kafka clusters for availability, performance, and security.
• Troubleshoot Kafka-related issues and provide 3rd level administrator support.
• Create and manage Kafka topics, producers, and consumers using Python.
• Develop automation for Kafka infrastructure and handle customer support queries.

Required Skills

• 5+ years of professional experience in data infrastructure administration.
• Expertise with Apache Kafka.
• Experience with big data technologies such as Hadoop and Spark.
• Proficiency in Python for developing Kafka consumers and producers.
• Ability to ensure 24/7 support availability during rotational service guard periods.
• Experience administering complex data infrastructure.

Preferred Skills

• Background in managing high-availability data systems.

Key Skills

Education

Any Gradute