Description

You design and maintain enterprise-grade data pipelines and integrations using Snowflake and Apache Airflow.

This role is on-site.

Responsibilities

• Design and implement Snowflake pipelines, including ingestion, transformation, and data sharing.
• Build and maintain ETL/ELT workflows using Apache Airflow with robust data quality checks.
• Optimize Snowflake performance via virtual warehouse sizing, clustering keys, and query profiling.
• Develop complex SQL transformations, stored procedures, and dynamic tables for batch and streaming processing.
• Integrate AI/LLM capabilities via Python UDFs and API callouts for semantic search and analytics.

Required Skills

• Snowflake: Core and semantic modeling, Snowpipe, Kafka-to-Snowflake streaming, SQL, and performance tuning.
• Python: Pandas, PyParsing, NumPy, and scripting for data pipeline automation.
• Apache Airflow: Building reusable, parameterized ingestion frameworks.
• SQL: Complex queries, recursive CTEs, materialized views, and dimensional data modeling (SCD Type 1, 2, 3).
• AI/Data Science: Experience with scikit-learn, PyTorch, TensorFlow, NLP, and time-series forecasting.
• Data Visualization: Hands-on experience with Tableau.
• 5+ years of experience in data engineering and integration.

Preferred Skills

• Experience with high-throughput event data at scale.
• Knowledge of text-mining techniques on unstructured data.

Key Skills

Education

Any Graduate