Description

You will architect and maintain scalable Databricks Lakehouse platforms across Azure, ensuring reliability, governance, and performance for enterprise data workloads.

This role is remote.

Responsibilities

• Design and support Delta Lake and Unity Catalog solutions within enterprise Databricks environments.
• Optimize Spark workloads, cluster configurations, and platform performance for batch and streaming processing.
• Integrate Databricks with Azure-native ecosystems, APIs, and storage accounts while aligning with CI/CD standards.
• Implement governance controls including RBAC, lineage, encryption, and operational security practices.
• Troubleshoot platform issues and contribute to documentation and operational best practices.

Required Skills

• 6+ years of experience in cloud, platform, or data engineering.
• 3+ years of hands-on experience with enterprise Databricks environments.
• Strong proficiency in Delta Lake, Unity Catalog, and Spark workload optimization.
• Experience managing Databricks Workspaces, Jobs, Notebooks, and Clusters.
• Familiarity with Azure Cloud services and cloud-native platform concepts.
• Hands-on experience with Azure DevOps, GitHub, and CI/CD pipeline automation.
• Understanding of Infrastructure as Code frameworks and deployment workflows.
• Ability to support multi-environment platform management (Dev, QA, Production).

Preferred Skills

• Experience with distributed application integrations and enterprise data platforms.
• Strong operational troubleshooting and root cause analysis capabilities.

Key Skills

Education

Bachelor's degree