Description

You will design and build data infrastructure to support advanced AI workflows, focusing on LLM-based systems and scalable data pipelines.

This role is hybrid.

Responsibilities

• Implement LLM-based workflows, RAG pipelines, and agentic orchestration using frameworks like LangChain, LangGraph, or CrewAI.
• Design, develop, and maintain scalable data pipelines using Python and Azure technologies.
• Containerize and deploy solutions using Docker, Kubernetes, and cloud-native architectures.
• Collaborate with data scientists and analysts to translate business requirements into data solutions.
• Ensure data quality, observability, and adherence to security standards across all pipelines.

Required Skills

• 9+ years of experience in data engineering with a focus on Python and Azure.
• Experience implementing AI and Generative AI workflows.
• Proficiency with CI/CD practices and deployment strategies.
• Hands-on experience with Docker and Kubernetes for containerization.
• Familiarity with cloud platforms including AWS.
• Bachelor's degree in Computer Science or equivalent.

Preferred Skills

• Experience with agentic orchestration frameworks (LangChain, LangGraph, CrewAI).

Key Skills

Education

Bachelor's degree