Description

You will build and manage data pipelines optimized for Large Language Models and Generative AI applications.

Responsibilities

• Develop and implement data workflows specifically for LLM integration.
• Build and maintain scalable data pipelines using AWS services.
• Deploy and manage API endpoints to support AI model consumption.
• Optimize data processing tasks within cloud-native environments.

Required Skills

• 5+ years of experience in data engineering.
• Proven experience working with Generative AI and LLM models.
• Hands-on experience with AWS Lambda.
• Proficiency with AWS Glue for data integration.
• Experience building interfaces with Streamlit.
• Ability to develop APIs using FastAPI.
• Degree in any graduate field.

Key Skills

Education

Any Graduate