Description

You will administer, configure, and optimize the Databricks platform to support data engineering, machine learning, and analytics activities.

Responsibilities

• Design, implement, and maintain Databricks workspaces, clusters, and environments aligned with security and performance best practices.
• Manage Unity Catalog for schema data, including catalog creation, external storage configuration, and access permissions.
• Monitor cluster performance, resource utilization, and platform costs while troubleshooting and resolving service issues.
• Implement and manage access controls, security policies, and compliance documentation to protect sensitive data.
• Provide operational support to data engineering, Data Science/ML, and integration teams, including root cause analysis and restores.

Required Skills

• 8+ years of relevant experience in data infrastructure or platform administration.
• Strong proficiency in PySpark, Python, and SQL.
• Deep understanding of AWS infrastructure, networking configurations, and resources related to Databricks.
• Experience using Databricks APIs and system tables for administrative queries and dashboards.
• Knowledge of compliance audits and audit documentation standards.
• Strong debugging skills and understanding of Databricks workspace and development environments.

Key Skills

Education

Any Graduate