Description

You will drive the development of ETL processes and data pipelines within Snowflake and SQL Server environments.

Responsibilities

• Lead the development and management of ETL processes for Program Integrity data marts.
• Design, build, and maintain data pipelines using Azure Data Factory to support ETL operations and profiling procedures.
• Implement DevOps practices to ensure efficient data loading and workload balancing.
• Monitor, optimize, and troubleshoot workflows to maintain performance and reliability.
• Identify and resolve complex technical issues independently to maintain operational efficiency.

Required Skills

• 5+ years of experience in cloud-based data engineering and data warehousing.
• 2+ years of focused experience with Snowflake, including automated ingestion using Snowflake SQL procedures and Python.
• Proficiency in Python and scripting languages for data manipulation and automation.
• Experience with Azure Data Factory (ADF), SQL Server, and Blob Storage.
• Hands-on expertise with Snowflake SQL, SnowSQL, and managing formats like CSV, JSON, and VARIANT.
• Technical proficiency in Snowpark, Apache Spark, pandas, NumPy, and Scikit-learn.
• Ability to develop cloud-native ETL processes on Azure and Snowflake.
• Any Graduate degree.

Preferred Skills

• Azure or Snowflake certification.
• Experience with data modeling, database design, and data governance.
• Familiarity with AWS or Google Cloud.

Key Skills

Education

Any Gradute