Description

Design and maintain scalable data pipelines, orchestration workflows, and governance frameworks on Snowflake.

This role is on-site.

Responsibilities

• Build resilient data pipelines using Snowpipe, Tasks, Streams, and Dynamic Tables with advanced SQL.
• Develop Python ingestion frameworks for CSV, JSON, XML, and complex Mainframe VSAM/EBCDIC formats.
• Configure Qlik Replicate for CDC and full-load replication from Oracle, SQL Server, and DB2.
• Implement metadata-driven schema evolution and drift detection to ensure downstream stability.
• Manage orchestration with Astronomer Airflow and enforce CI/CD via GitLab and Azure DevOps.

Required Skills

• 12+ years of hands-on data engineering experience.
• Deep expertise in Snowflake, including performance tuning, RBAC, and data masking policies.
• Strong proficiency in Python and PySpark for ingestion and automation.
• Experience with DBT Cloud for model testing, documentation, and lineage.
• Hands-on experience with Qlik Replicate for database replication.
• Proficiency in Astronomer Airflow for workflow scheduling and observability.
• Experience with Protegrity tokenization and data governance standards.

Preferred Skills

• Experience with semi-structured data formats and fixed-width multi-record layouts.

Key Skills

Education

Bachelor's degree