Description

You will build and manage data pipelines to migrate data from Hadoop to Snowflake.

Responsibilities

• Design and implement scalable data pipelines and service modules to support business user demands.
• Build systematic processes and services to support data set onboarding into the data virtualization layer.
• Collaborate with data analysts, business end-users, and platform teams to implement and support data platforms.
• Analyze systems operations data, including SLAs and delivery quality, to identify trends for continual improvement.

Required Skills

• 5+ years of experience as a data engineer in the big data field.
• Hands-on experience implementing ETL pipelines using Informatica BDM (DEI).
• Proficiency with Hadoop ecosystems, including HDFS, Hive, and Impala.
• Strong SQL and Python programming skills.
• Experience with Snowflake and RDBMS platforms.
• Proficiency in Linux/Unix environments, including shell scripting and command line tools.
• Experience with application integration involving Oracle, MS-SQL, or MySQL.
• Understanding of SDLC, Agile (Scrum/Kanban), CI/CD workflows, and code versioning.
• Bachelor’s degree in Computer Science, Computer Engineering, or equivalent.

Preferred Skills

• Working knowledge of Oracle and MS-SQL.
• Experience with AWS services including S3 and EMR.

Key Skills

Education

Any Graduate