Description

You build and maintain the infrastructure enabling ML models to run reliably in production.

Responsibilities

• Design and implement scalable model serving platforms for batch and real-time inference.
• Build model deployment pipelines including automated testing and validation.
• Develop monitoring, logging, and alerting systems for ML services.
• Implement model versioning and rollback capabilities.
• Create infrastructure supporting A/B testing and model experimentation.

Required Skills

• 7+ years of software engineering experience, including 3+ years in ML serving/infrastructure.
• Expertise in Kubernetes and cloud platforms.
• Proficiency in Python and high-performance serving implementation.
• Experience with TensorFlow Serving, Triton, and KServe.
• Strong knowledge of distributed systems and microservices architecture.
• Experience implementing CI/CD pipelines and GitOps workflows.

Preferred Skills

• Experience with TorchServe or BentoML.
• Expertise in model runtime optimizations (quantization, pruning, compression).

Key Skills

Education

Any Graduate