Description

Build and manage data pipelines to migrate data from Hadoop to Snowflake, supporting business user demands and data virtualization onboarding.

This role is on-site.

Responsibilities

• Design and implement scalable data pipelines and service modules using Informatica BDM.
• Build systematic processes for data set onboarding into the data virtualization layer.
• Collaborate with data analysts and platform teams to support data platforms.
• Analyze system operations data, including SLAs, to identify trends for continual improvement.
• Manage application integration involving Oracle, MS-SQL, or MySQL.

Required Skills

• 5+ years of experience as a data engineer in the big data field.
• Hands-on experience implementing ETL pipelines using Informatica BDM (DEI).
• Proficiency with Hadoop ecosystems, including HDFS, Hive, and Impala.
• Strong SQL and Python programming skills.
• Experience with Snowflake and RDBMS platforms.
• Proficiency in Linux/Unix environments, including shell scripting.
• Understanding of SDLC, Agile workflows, CI/CD, and code versioning.

Preferred Skills

• Working knowledge of Oracle and MS-SQL.
• Experience with AWS services including S3 and EMR.

Key Skills

Education

Any Graduate