Description

You will build and maintain production-grade machine learning and data pipelines using Python, PySpark, and Databricks.

This role is on-site.

Responsibilities

• Develop and optimize data pipelines using PySpark, Databricks, and Spark.
• Build production-grade ML workflows and integrate them with MLflow.
• Design and implement APIs using FastAPI for model serving.
• Manage data modeling for SQL (PostgreSQL) and NoSQL (MongoDB) systems, including slowly changing dimensions.
• Deploy and manage infrastructure on Azure cloud.

Required Skills

• Strong Python development skills with 5+ years of experience.
• Hands-on experience with PySpark, Databricks, and Apache Spark.
• Proficiency with MLflow for model lifecycle management.
• Experience with Azure cloud services.
• Solid understanding of SQL (PostgreSQL) and NoSQL (MongoDB).
• Familiarity with Kafka, Redis, and Snowflake.
• Experience with Delta Lake and workflow orchestration.

Preferred Skills

• Experience with GenAI and agentic development.
• Familiarity with ELK stack (Elasticsearch, Kibana).
• Exposure to classical ML/DS with production pipeline design.

Key Skills

Education

Any Graduate