Description

Design and implement data management solutions using Snowflake and AWS cloud technologies.

Design and build manual or automated data ingestion pipelines using Snowpipe. Migrate data from on-premises database environments to Snowflake. Develop automated monitoring processes using Python, PySpark, Bash, and SnowSQL. Optimize Snowflake performance through SQL tuning, re-clustering, and managing micro-partitions. Implement Snowflake security and resource management including RBAC, resource monitors, and virtual warehouses.

Responsibilities

• Design and build data ingestion pipelines using Snowpipe.
• Migrate data from on-premises environments to Snowflake.
• Develop automated monitoring processes using Python, PySpark, Bash, and SnowSQL.
• Optimize Snowflake performance through SQL tuning, re-clustering, and micro-partition management.
• Implement security and resource management including RBAC, resource monitors, and virtual warehouses.

Required Skills

• 8+ years of experience implementing data management solutions.
• Expertise in Snowflake concepts: zero-copy cloning, time travel, and scalable virtual warehouses.
• Experience handling semi-structured data (JSON, XML) and columnar PARQUET using the VARIANT attribute.
• Proficiency in AWS services including S3, SQS, EC2, Lambda, Redshift, and RDS.
• Ability to develop stored procedures and write complex queries for data transformation.
• Hands-on experience with Python, PySpark, Bash, and SnowSQL.
• Deep understanding of Snowflake micro-partitions and data re-clustering.

Key Skills

Education

Any Gradute