Description

You will architect and lead large-scale data platforms using Databricks, providing technical and people leadership to design lakehouse and analytic products.

This role is remote.

Responsibilities

• Design and implement large-scale platform and data architectures on Databricks.
• Lead migration from Hive Metastore to Unity Catalog, implementing unified access control.
• Design and build complex data pipelines for batch and streaming sources on Databricks.
• Build a Terraform-based Databricks IaaS framework to support workspace and IAM operations.

Required Skills

• 7+ years of experience in data architecture and engineering.
• Proficiency in Databricks, Python, and Scala.
• Experience with Kafka, No-SQL databases, and DBT.
• Experience with AWS and Azure cloud platforms.
• Knowledge of RBAC, ABAC, and CBAC for data governance.
• Proven experience architecting horizontally scalable data platforms.
• Familiarity with MLFlow and vector databases.

Preferred Skills

• Experience leading technical teams in data platform development.

Key Skills

Education

Any Graduate