Description

You will manage Azure Databricks environments and ensure platform stability.

Responsibilities

• Administer Databricks clusters and workspaces, including Unity Catalog and metastore configuration.
• Manage Delta Lake and Lakehouse architecture to support data engineering workflows.
• Automate provisioning and configuration using Terraform and Databricks REST APIs.
• Tune Spark configurations for optimal performance and resource utilization.
• Implement IAM policies, networking rules, and cloud security best practices.

Required Skills

• 10+ years of experience in Databricks administration or cloud data platform support.
• Deep expertise with Azure Databricks, including cluster management and workspace administration.
• Proficiency in Python, SQL, Bash, and PowerShell for automation and scripting.
• Hands-on experience with Terraform for infrastructure as code.
• Strong understanding of Azure data services and cloud storage (ADLS, S3, GCS).
• Experience configuring CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins.
• Knowledge of Databricks REST APIs, CLI, and Spark performance tuning.
• Understanding of IAM, networking, and cloud security principles.

Key Skills

Education

Any Gradute