Description

Administer and support the Databricks workspace environment across development, test, and production. Manage user provisioning, role-based access controls, service principals, groups, and entitlements.

Responsibilities

• Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.
• Monitor platform health, job performance, usage trends, and operational incidents.
• Implement security controls for secrets management, data access, encryption, private connectivity, and audit logging.
• Support Unity Catalog, data governance standards, and workspace-level administration.
• Develop automation for workspace setup, policy enforcement, and administrative tasks using Python, PowerShell, or Bash.

Required Skills

• 5+ years of experience with Azure Cloud.
• Strong understanding of identity and access management, including SSO, SCIM, RBAC, and service principals.
• Experience with Databricks cluster management, workspace administration, job orchestration, and governance controls.
• Knowledge of networking concepts such as VNet/VPC, private endpoints, firewalls, DNS, and secure connectivity.
• Proficiency in scripting or automation using Python, PowerShell, Bash, Terraform, or similar tools.
• Familiarity with monitoring, logging, alerting, and incident response processes.
• Understanding of data engineering workflows using Spark, notebooks, Delta Lake, and job scheduling.

Preferred Skills

• Experience with CI/CD and infrastructure-as-code practices for Databricks deployments.
• Ability to troubleshoot platform, connectivity, identity federation, and job execution issues.

Key Skills

Education

Bachelor's degree