Description

Build and orchestrate systems managing user interactions with Large Language Models and critical services in high-volume production environments.

Responsibilities

• Orchestrate LLM-driven experiences and develop novel LLM client code.
• Write Python API server code to handle requests from multiple front-end clients.
• Develop intuitive prompting frameworks to empower prompt engineers and subject matter experts.
• Write SQL queries and contribute to database schema design.
• Participate in high-level architecture discussions within the Applied ML team.

Required Skills

• 5+ years of production-level software engineering experience.
• Proficiency in Python.
• Experience with HTTP and API development.
• Strong SQL skills and experience with database schema design.
• Experience using LLMs through code (e.g., OpenAI, Anthropic, Cohere, Llama, or Mistral).
• Experience with ML development lifecycle stages: data curation, cleaning, model training, evaluation, serving, or prompting.
• Strong software engineering judgment and analytical problem-solving skills.

Preferred Skills

• Previous experience working on an engineering or product team within a startup environment.

Key Skills

Education

Any Graduate