Description

Manage and optimize the Databricks platform to support large-scale data and machine learning workflows.

This role is on-site.

Responsibilities

• Administer Databricks workspaces, handling user provisioning, cluster governance, and job orchestration.
• Automate infrastructure provisioning and lifecycle management using Terraform and Python.
• Design and implement disaster recovery, high availability strategies, and multi-region backups.
• Optimize platform performance and costs through cluster policy enforcement and resource monitoring.
• Support MLflow, MLOps pipelines, and Mosaic AI for experimentation and deployment.

Required Skills

• 10+ years in cloud infrastructure, platform operations, or data platform administration.
• Proven experience managing Databricks or similar cloud data platforms at scale.
• Expertise with Databricks components: Unity Catalog, MLflow, Mosaic AI, and Delta Live Tables.
• Proficiency in Infrastructure as Code using Terraform and Python.
• Experience with AWS services including S3, IAM, and networking.
• Knowledge of CI/CD using GitHub Actions or similar tools.
• Experience with SCIM provisioning, role-based access, and audit logging.
• Ability to architect data lake/lakehouse environments and high availability systems.

Preferred Skills

• Experience with Docker and GitHub.

Key Skills

Education

Any Gradute