Description

Key Skills: Azure Databricks, Terraform, Databricks, Python, Azure, IAC, Data Bricks, Rbac, Entra ID, Cluster, Azure Key Vault, Spark

Roles and Responsibilities:

• Design and maintain IaC modules using Terraform for Databricks workspaces, clusters, cluster policies, and permissions to prevent manual drift.
• Develop Databricks Asset Bundle templates for jobs, DLT pipelines, SQL assets, and workspace configurations.
• Implement workspace bootstrap automation for repos, catalogs, schemas, and service principal setup.
• Integrate Azure Key Vault for secrets and configuration management with zero inline secrets; enforce Unity Catalog governance models and permission hierarchies.
• Build audit logging pipelines for workspace events, Unity Catalog audits, and job logs routed to central monitoring/SIEM; define compliance controls for masking and retention across environments.

Skills Required:

• 3.1 - 4.5 years of relevant platform/infrastructure engineering experience with Databricks or Azure data platforms.
• Azure and Azure Databricks platform development and administration experience.
• Terraform-based infrastructure-as-code for Databricks infrastructure and policies.
• Python proficiency for platform automation and operational tooling.
• CI/CD standards and deployment automation using Databricks Asset Bundles and promotion gates across Dev/QA/Prod.

Good to Have:

• Spark experience for Databricks workloads and pipeline optimization.
• Experience working with Databricks cluster configuration and related operational controls.

Education: Relevant degree (or equivalent practical experience) in Computer Science, Engineering, or a related field

Key Skills

Education

Any Graduate