Description

You will manage and optimize Apache Kafka to support distributed event streaming and data workflows.

Responsibilities

• Manage Kafka topics, partitions, and replication to maintain high availability and fault tolerance.
• Configure and manage Kafka Producers and Consumers to ensure efficient message streaming.
• Integrate Kafka with various applications and data systems to ensure smooth communication across the ecosystem.
• Execute ETL processes using Kafka to extract data from IBM InfoSphere Data Replication (IIDR) and load it into Snowflake.

Required Skills

• 12+ years of experience in data engineering or related roles.
• Deep expertise in Apache Kafka setup, configuration, and management.
• Hands-on experience with Kafka Producers and Consumers.
• Experience with IBM InfoSphere Data Replication (IIDR).
• Experience managing data pipelines involving Snowflake.
• Strong understanding of distributed event streaming platforms.
• Ability to design and implement fault-tolerant streaming architectures.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate