Description

Design and deploy Databricks Lakehouse applications with Python backends, managing data pipelines and UI services.

This role is on-site.

Responsibilities

• Build and deploy Databricks Applications using Python-based backends.
• Create comprehensive batch and streaming data pipelines on Azure Databricks.
• Develop full-stack applications utilizing Python, Django, Flask, and Streamlit.
• Deploy Python services via Kubernetes for scalable solutions.
• Implement Medallion Architecture and Unity Catalog with Delta Lake.

Required Skills

• 5+ years of experience with Databricks app development and deployment.
• Strong knowledge of Delta Lake, Lakehouse, and Medallion Architecture.
• Proficiency in advanced Python development and backend frameworks (Django, Flask).
• Experience with UI development using Streamlit.
• Experience deploying applications on Kubernetes.
• Familiarity with data governance, lineage, and certification processes, especially with Collibra.

Preferred Skills

• Experience with Azure Databricks specifically.
• Background in data governance tools.

Key Skills

Education

Any Graduate