Description

Design, deploy, and operate scalable Kubernetes platforms supporting AI and machine learning workloads.

This role is remote.

Responsibilities

• Manage and optimize batch scheduling frameworks like Volcano and Kueue for efficient GPU resource utilization.
• Lead infrastructure modernization and migration initiatives across cloud-native environments.
• Develop platform automation, deployment pipelines, and infrastructure tooling using Infrastructure-as-Code practices.
• Build and maintain scalable observability frameworks for Kubernetes and GPU-based workloads.
• Drive operational excellence through monitoring, performance tuning, capacity planning, and incident response.

Required Skills

• Strong hands-on experience with Kubernetes and batch scheduling frameworks (Volcano, Kueue, or similar).
• Proficiency in Python and Golang.
• Experience with Infrastructure-as-Code tools such as Terraform and Helm.
• Experience implementing observability solutions using Prometheus and Grafana.
• Understanding of distributed systems, containerization, and cloud-native architectures.
• Experience managing large-scale workloads on Kubernetes, preferably AWS EKS.
• 5+ years of experience in platform or infrastructure engineering.

Preferred Skills

• Experience supporting large-scale AI/ML training or inference platforms.
• Knowledge of GPU resource management and optimization.
• Familiarity with MLOps and machine learning infrastructure ecosystems.

Key Skills

Education

Bachelor's degree