Description

You will manage and optimize production environments for machine learning workloads and inference endpoints.

Responsibilities

• Operate, monitor, and triage all aspects of production and non-production environments.
• Automate deployment and orchestration of services across AWS and GCP cloud environments.
• Troubleshoot customer concerns regarding ML tuning and Ray inference endpoints.
• Design and implement RESTful or RPC APIs and services using Golang or Python.
• Implement SLO/SLI and error budget reporting for various customers.
• Participate in capacity planning, scale testing, and disaster recovery exercises.

Required Skills

• 5+ years of professional experience.
• Deep understanding of GPU efficiency and GPU optimization.
• Experience with AWS and GCP.
• Proficiency in Python or Golang.
• Experience designing RESTful and RPC APIs.
• Knowledge of ML tuning and Ray inference endpoints.
• Ability to manage cloud-based service orchestration.

Key Skills

Education

Any Graduate