Description

You will design and maintain the Databricks platform infrastructure, ensuring governance, automation, and security across Azure environments.

This role is on-site.

Responsibilities

• Develop and manage Infrastructure-as-Code modules using Terraform for Databricks workspaces, clusters, policies, and permissions.
• Build Databricks Asset Bundle templates for jobs, Delta Live Tables (DLT) pipelines, SQL assets, and workspace configurations.
• Implement workspace bootstrap automation for repos, catalogs, schemas, and service principal setups.
• Integrate Azure Key Vault for secrets management and enforce Unity Catalog governance models and permission hierarchies.
• Create audit logging pipelines for workspace events and job logs, routing data to central monitoring and SIEM systems.

Required Skills

• 5+ years of platform or infrastructure engineering experience with Azure Databricks or Azure data platforms.
• Strong proficiency in Terraform for managing Databricks infrastructure and policies.
• Advanced Python skills for platform automation and operational tooling.
• Experience with CI/CD standards, deployment automation, and Databricks Asset Bundles across Dev/QA/Prod environments.
• Deep understanding of Azure services including Entra ID, RBAC, and Azure Key Vault.
• Familiarity with Unity Catalog governance, masking, and retention controls.
• Experience with Spark workloads and cluster configuration optimization.

Preferred Skills

• Relevant degree in Computer Science, Engineering, or equivalent practical experience.
• Experience defining compliance controls for data security in cloud environments.

Key Skills

Education

Any Graduate