Description

You will design, implement, and manage scalable Databricks platforms on Azure.

This role is on-site.

Responsibilities

• Design and implement Databricks workspaces and clusters, managing resource lifecycle and right-sizing.
• Automate infrastructure provisioning and deployments using Infrastructure as Code tools and scripting.
• Monitor platform health, performance, and cost, building dashboards and integrating with monitoring tools.
• Troubleshoot cluster configuration issues, job failures, and performance bottlenecks.
• Collaborate with data science and ML teams to deploy and maintain data pipelines.

Required Skills

• 5+ years architecting, deploying, and supporting Azure Databricks Platform and Azure Data Lake solutions.
• Hands-on experience with Azure cloud provider tools and architecture.
• Proficiency in Python, Bash, PowerShell, Terraform, Ansible, and SQL.
• Experience implementing security and governance policies using Unity Catalog.
• Knowledge of ETL patterns and tools including Delta Lake.
• Experience working within an agile product development team.

Key Skills

Education

Any Gradute