Description

You will architect and deploy core APIs and SDKs to access LLMs and proprietary foundation models. You own the interface design for performance, scale, and governance automation.

Responsibilities

• Architect, build, and deploy APIs and orchestration SDKs for training, fine-tuning, and prompting tasks.
• Design interfaces for real-time applications, scale, and governance automation.
• Develop application-specific interfaces leveraging LLMs and foundation models to enhance user experiences.
• Implement AI safety and guardrails within the API layer in collaboration with researchers.
• Build tools and processes to monitor API access patterns and operational health.

Required Skills

• Bachelor’s degree in Computer Science, Computer Engineering, or a technical field.
• 6+ years of experience designing and building data-intensive solutions using distributed computing and cache optimization.
• 6+ years of professional programming experience in Python, Go, Scala, or Java.
• 1+ years of experience building, scaling, and optimizing training or inferencing systems for deep neural networks.
• Hands-on experience with GenAI technologies.

Preferred Skills

• Experience deploying large neural network models in demanding production environments.
• Familiarity with building large-scale AI platforms for NLP, speech, computer vision, or recommendation systems.
• Knowledge of API security, observability, cloud access control, and privacy best practices.

Key Skills

Education

Bachelor's degree