Design and develop data ingestion and processing flows within a Snowflake data warehouse environment.
Responsibilities
- Design and develop data ingestion and processing flows using Python and SnowSQL.
- Create high-level design artifacts and deliver high-quality code throughout the SDLC.
- Interface with stakeholders to manage requirements elicitation, application development, and design.
- Identify test scenarios and lead validation activities for implementation and transition.
- Migrate data from RDBMS to Snowflake cloud data warehouse environments.
Required Skills
- 5-8 years of experience designing and implementing ETL data ingestion and processing pipelines.
- 3+ years of experience implementing operational solutions on Snowflake Data Warehouse.
- Extensive experience with SQL and RDBMS databases.
- Hands-on experience with Snowflake utilities, SnowSQL, and SnowPipe.
- Proficiency in using Python for Big Data model techniques.
- Experience developing stored procedures and writing queries for data transformation.
- Deep understanding of relational and NoSQL data stores, including star and snowflake schemas and dimensional modeling.
- Knowledge of Snowflake internals and integration with reporting technologies.
- Experience in the full data integration lifecycle: designing, coding, testing, deploying, and supporting applications.