Description

You design and implement Databricks Lakehouse platforms using Medallion Architecture and Unity Catalog, building full-stack applications with Python backends.

This role is on-site.

Responsibilities

• Design and implement Databricks Lakehouse/Lakebase platforms using Medallion Architecture and Unity Catalog.
• Build and deploy Databricks applications with Python-based backends.
• Create comprehensive batch and streaming data pipelines on Azure Databricks.
• Develop full-stack applications using Python, Django, Flask, and Streamlit.
• Deploy Python services and applications using Kubernetes for scalable solutions.

Required Skills

• 10+ years of experience with Databricks application development and deployment.
• Strong knowledge of Delta Lake, Lakehouse architecture, and Medallion Architecture.
• Proficiency in advanced Python development and backend frameworks such as Django and Flask.
• Experience with UI development using Streamlit.
• Experience deploying applications on Kubernetes.
• Familiarity with data governance, lineage, and certification processes, especially with Collibra.

Key Skills

Education

Any Graduate