Description

You will design and scale production-grade data pipelines optimized for AI workflows, including LLM fine-tuning and RAG patterns.

This role is remote.

Responsibilities

• Integrate AI APIs (OpenAI, Hugging Face, Anthropic) into data transformation and downstream usage layers.
• Lead cleaning, transformation, and feature engineering of large-scale datasets for AI model training and inference.
• Deploy and support AI solutions in production, managing monitoring, scaling, and issue resolution.
• Develop and maintain dbt-based transformation layers while optimizing Snowflake performance.
• Implement API and event-driven ingestion pipelines ensuring data quality and reliability.

Required Skills

• 6–10+ years of hands-on data engineering experience.
• Deep expertise in Python, dbt, and Snowflake.
• Proven track record of integrating LLM/AI APIs into complex data pipelines.
• Advanced experience in preparing and structuring large-scale data for AI model usage.
• Strong mastery of Airflow or similar orchestration tools.
• Solid understanding of data modeling and production-grade pipeline construction.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with event-driven architecture and real-world data issue resolution.
• Background in optimizing analytical workloads for AI-driven use cases.

Key Skills

Education

Bachelor's degree