Description

Build and maintain data and ML infrastructure to support production systems.

Responsibilities

• Build and manage data pipelines using Spark and Iceberg.
• Maintain production systems, including deployments, releases, and CI/CD pipelines.
• Operate distributed systems and infrastructure using Kubernetes and Helm.
• Collaborate with internal customers to meet data and ML operational requirements.

Required Skills

• 5+ years of experience in data or machine learning engineering.
• Proficiency in Python and Java.
• Hands-on experience with Spark and Iceberg.
• Strong knowledge of Postgres SQL.
• Experience with Kubernetes and Helm.
• Practical understanding of CI/CD pipelines and production deployments.
• Working knowledge of AWS S3.
• Understanding of distributed systems.
• Bachelor's degree in any field.

Preferred Skills

• Familiarity with the machine learning lifecycle and tools like PyTorch or TensorFlow.
• Knowledge of Apache Superset.

Key Skills

Education

Any Graduate