Description

You will design, build, and maintain scalable data pipelines and governance frameworks within a Snowflake-centric environment.

This role is on-site.

Responsibilities

• Design and implement resilient data pipelines using Snowflake features like Snowpipe, Tasks, Streams, and Dynamic Tables, alongside advanced SQL.
• Build and maintain dbt models with rigorous testing, documentation, and lineage tracking to ensure data quality.
• Develop Python ingestion frameworks for files and APIs, handling schema validation, retries, and metadata capture for diverse formats including CSV, JSON, XML, and Mainframe VSAM.
• Configure and manage Qlik Replicate for CDC and full-load replication from Oracle, SQL Server, and DB2, ensuring idempotent and auditable processes.
• Implement data governance strategies including Snowflake masking policies, Protegrity tokenization, and RBAC enforcement.

Required Skills

• 12+ years of hands-on data engineering experience.
• Deep expertise with Snowflake, including data masking, RBAC, performance tuning, and advanced SQL.
• Strong proficiency in Python and PySpark for building ingestion frameworks and automation.
• Hands-on experience with dbt Cloud for data transformation and modeling.
• Experience with Astronomer Airflow for orchestration, dependency management, and SLA monitoring.
• Proficiency with Qlik Replicate for database replication and CDC.
• Familiarity with CI/CD workflows using GitLab and Azure DevOps.

Preferred Skills

• Experience with Mainframe VSAM data ingestion and EBCDIC format handling.
• Knowledge of metadata-driven schema evolution and drift detection strategies.

Key Skills

Education

Bachelor's degree