Description

You own the administration, governance, and cost optimization of the Databricks platform on AWS.

This role is on-site.

Responsibilities

• Administer Databricks workspaces, including Unity Catalog, RBAC, SSO, SCIM, and cluster policies.
• Manage interactive, job, and SQL warehouse clusters alongside serverless compute resources.
• Oversee platform monitoring, auditing, compliance, and multi-workspace environment governance.
• Optimize Databricks costs through FinOps practices and consumption analysis.
• Troubleshoot platform issues and perform root-cause analysis for job failures and infrastructure problems.

Required Skills

• 15+ years of overall IT experience with 5+ years specifically in Databricks Administration.
• Hands-on expertise administering Databricks on AWS, including IAM, S3, VPC, and Security Groups.
• Deep knowledge of Unity Catalog governance, security administration, and access management.
• Strong understanding of Hive Metastore, Hive tables, catalogs, schemas, and views.
• Proficiency in cluster administration for interactive, job, and SQL workloads.
• Ability to troubleshoot using knowledge of Databricks Lakehouse architecture, Apache Spark, and Delta Lake.
• Experience with platform upgrades, runtime management, and workspace provisioning.

Preferred Skills

• Experience migrating from Hive Metastore to Unity Catalog.
• Exposure to Databricks Genie AI capabilities and governance within Unity Catalog.
• Databricks certifications are a plus.

Key Skills

Education

Bachelor's degree