Description

You will manage and optimize Apache Kafka for distributed event streaming and data workflows, integrating with IBM InfoSphere Data Replication (IIDR) and Snowflake.

This role is on-site.

Responsibilities

• Manage Kafka topics, partitions, and replication to ensure high availability and fault tolerance.
• Configure and manage Kafka Producers and Consumers for efficient message streaming.
• Integrate Kafka with various applications and data systems to ensure ecosystem communication.
• Execute ETL processes using Kafka to extract data from IIDR and load it into Snowflake.

Required Skills

• 12+ years of experience in data engineering or related roles.
• Deep expertise in Apache Kafka setup, configuration, and management.
• Hands-on experience with Kafka Producers and Consumers.
• Experience with IBM InfoSphere Data Replication (IIDR).
• Experience managing data pipelines involving Snowflake.
• Strong understanding of distributed event streaming platforms.
• Ability to design and implement fault-tolerant streaming architectures.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate