Description

Lead the design and development of scalable data pipelines and AI-driven analytics architectures.

This role is remote.

Responsibilities

• Design, build, and optimize scalable data pipelines using Azure Data Factory, DBT, and Databricks.
• Develop modular, testable DBT models for data transformation and analytics.
• Implement data orchestration and workflow automation within Azure environments.
• Build and maintain Snowflake-based architectures, leveraging Snowflake Cortex for anomaly detection, forecasting, and text processing.
• Implement data validation frameworks using Snowflake Cortex and Snowpark UDFs.

Required Skills

• 7+ years of experience in data engineering.
• Deep expertise in Azure Data Factory, DBT, and Databricks.
• Advanced proficiency in Snowflake and Snowpark APIs.
• Hands-on experience with Snowflake Cortex ML and LLM functions.
• Strong proficiency in Python and SQL.
• Experience with open-source LLMs and GenAI integration within Snowflake.
• Expertise in data modeling, transformation, and pipeline optimization.

Preferred Skills

• Experience integrating Snowflake Cortex with UI tools including Copilot, Universal Search, and Document AI.

Key Skills

Education

Any Graduate