Description

Build and manage data pipelines and migration processes within a Snowflake environment.

Responsibilities

• Execute data migrations using flat files and implement ingestion logic.
• Develop ETL processes using Python, Unix scripting, and DBT.
• Perform data validation and unit testing to ensure data integrity.
• Support job scheduling, activity monitoring, and reconciliation processes.
• Write and tune complex SQL queries for optimal performance.

Required Skills

• 5+ years of experience in data engineering or development.
• Expertise in Snowflake utilities including SnowSQL, SnowPipe, Tasks, Streams, and Time Travel.
• Advanced SQL proficiency for writing complex, performance-tuned queries.
• Strong Python and Unix scripting skills for ETL development.
• Hands-on experience with ETL architecture and DBT.
• Deep understanding of data modeling including star schemas, 3NF, and ERDs.
• Experience with RDBMS such as Azure or SQL Server.
• Proficiency with GitHub and Jenkins.
• Familiarity with Agile delivery processes.

Preferred Skills

• Experience with Snowflake Optimizer and Metadata Manager.
• Knowledge of Snowflake data sharing and stored procedures.

Key Skills

Education

Any Graduate