Description

You will own the administration and governance of the Databricks platform.

Responsibilities

• Configure and optimize Databricks workspaces across development, test, and production environments.
• Manage clusters, jobs, SQL warehouses, repos, and runtime configurations to ensure performance and cost efficiency.
• Implement and enforce RBAC, workspace policies, and Unity Catalog standards.
• Develop automation tools and scripts for provisioning, monitoring, and operational workflows.
• Establish observability, health metrics, and alerting for Databricks resources and pipelines.

Required Skills

• 5+ years administering Databricks or similar large-scale data processing platforms.
• Strong proficiency with Apache Spark, Delta Lake, and Unity Catalog.
• Software engineering experience with Python and/or Scala, REST APIs, and automation tooling.
• Practical knowledge of regulatory frameworks (SOX, HIPAA) and experience implementing operational controls in cloud environments.
• Ability to design secure configurations, audit logging pipelines, and governance frameworks.
• Experience with Terraform and Azure.
• Familiarity with AWS.

Preferred Skills

• Databricks certifications (Associate or Professional).
• Experience with Infrastructure-as-Code tools (Terraform, ARM).

Key Skills

Education

Bachelor's degree