Description

Design and lead end-to-end data architecture using Databricks Lakehouse.

This role is on-site.

Responsibilities

• Define and implement Lakehouse and Medallion architecture layers (Bronze, Silver, Gold).
• Architect scalable batch and real-time data pipelines using Apache Spark and Databricks.
• Establish data modelling standards including conceptual, logical, and physical models.
• Implement data governance, security, and compliance using Unity Catalog, RBAC, and data lineage.
• Optimize data performance, scalability, and cost across cloud environments.

Required Skills

• 5+ years of experience in data architecture and engineering.
• Deep expertise with Databricks Lakehouse platform.
• Strong proficiency in Apache Spark for large-scale data processing.
• Experience with MLflow and Feature Store for advanced analytics and ML use cases.
• Solid understanding of data governance, security, and compliance frameworks.
• Proven ability in data modelling (conceptual, logical, physical).
• Hands-on experience with Unity Catalog and RBAC implementation.

Preferred Skills

• Technical leadership and mentoring experience for data engineering teams.
• Experience collaborating with cloud, analytics, and business teams to align data strategy.

Key Skills

Education

Bachelor's degree