Description

You will design and build data pipelines for large-scale migrations from on-premises systems to Snowflake.

Responsibilities

• Design and build Talend pipelines to implement Type 2 Slowly Changing Dimensions (SCD) models in Snowflake.
• Analyze on-premises data sources including DB2, Oracle, and Hadoop for migration and integration.
• Develop data replication strategies using IBM Data Replicator and Qlik Replicate.
• Implement one-time migration processes for history and archives alongside CDC-based update pipelines.
• Perform data profiling, validation, and reconciliation to ensure integrity during migrations.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Talend ETL development and Snowflake integration.
• Hands-on experience with IBM Data Replicator and Qlik Replicate.
• Strong knowledge of Snowflake architecture and Type 2 SCD modeling.
• Experience with DB2, Oracle, and Hadoop data sources.
• Understanding of Change Data Capture (CDC) and real-time replication patterns.
• Proficiency in SQL, Python, or Shell scripting for automation and transformations.

Preferred Skills

• Experience with Git, CI/CD pipelines, and data governance frameworks.
• Exposure to Kafka or other streaming platforms for data ingestion.

Key Skills

Education

Any Graduate