Description

Key Requirements

• 15+ years of overall IT experience with 5+ years in Databricks Administration.
• Strong hands-on expertise in:
  • Databricks Workspace Administration
  • Unity Catalog Administration and Governance
  • RBAC, SSO, SCIM, and Security Administration
  • Cluster Administration (Interactive, Job Clusters, SQL Warehouses, Serverless)
  • Databricks Cost Management, Pricing, and FinOps Optimization
  • Platform Monitoring, Auditing, and Compliance
  • Multi-workspace Administration
  • Hive Metastore and Hive Tables Administration
• Experience managing:
  • Catalogs, Schemas, Tables, Views, and Storage Credentials
  • Cluster Policies and Compute Governance
  • User and Access Management
  • Platform Upgrades and Runtime Management
  • Workspace Provisioning and Environment Governance

AWS Platform Expertise (Mandatory)

• Hands-on experience administering Databricks on AWS.
• Strong knowledge of:
  • AWS IAM
  • S3 Storage
  • VPC, Security Groups, and Networking
  • Secrets Management
  • Cloud Governance and Security Best Practices
• Experience working in enterprise-scale AWS-based Data & Analytics environments.

Technical Understanding

Although this is not a development role, the candidate must possess a good understanding of:

• Databricks Lakehouse Architecture
• Apache Spark
• Delta Lake
• Hive Metastore and Hive Tables
• Data Engineering workflows

This knowledge is required to troubleshoot platform issues, analyze job failures, perform root-cause analysis, and support engineering teams when required.

Preferred Skills

• Experience with Hive Metastore to Unity Catalog migrations.
• Strong understanding of Databricks pricing models and consumption optimization.
• Exposure to Databricks Genie AI / GenAI capabilities and their governance within Unity Catalog.
• Experience implementing enterprise security, governance, and compliance controls.
• Databricks certifications are a plus.

Ideal Candidate Profile

• Hands-on Databricks Administrator, not a Databricks Developer.
• Expert in Unity Catalog, Security, RBAC, Governance, and Cost Optimization.
• Strong experience managing clusters, SQL Warehouses, and workspace administration.
• Deep knowledge of Hive Metastore and Hive tables.
• Able to independently own and govern the Databricks platform on AWS.
• Capable of troubleshooting and debugging platform and workload issues while working closely with Data Engineering, Cloud, Security, and Infrastructure teams.

Mandatory Skills: AWS Databricks, Unity Catalog, RBAC, Security Administration, Cluster Administration, SQL Warehouses, Cost Optimization, Platform Governance, Hive Metastore/Hive Tables, Monitoring & Compliance

Key Skills

Education

Bachelor's degree