Description

You will build and maintain the infrastructure that supports machine learning models in production.

Responsibilities

• Design and implement scalable model serving platforms for batch and real-time inference.
• Build model deployment pipelines featuring automated testing and validation.
• Develop monitoring, logging, and alerting systems for ML services.
• Create infrastructure for A/B testing and model experimentation.
• Implement model versioning and rollback capabilities.

Required Skills

• 7+ years of software engineering experience, including 3+ years in ML serving/infrastructure.
• Strong expertise in Kubernetes and major cloud platforms.
• Experience with model serving technologies like TensorFlow Serving, Triton, or KServe.
• Deep knowledge of distributed systems and microservices architecture.
• Proficiency in Java or Python with experience in high-performance serving.
• Strong background in monitoring and observability tools.
• Experience with CI/CD pipelines and GitOps workflows.

Key Skills

Education

Any Gradute