Description

You will design, build, and deploy interactive web applications and data pipelines on the Databricks platform. Your work integrates machine learning models with business-facing UIs while ensuring robust CI/CD practices and data governance.

This role is on-site.

Responsibilities

• Design and deploy custom web applications and data UIs using Databricks Apps to expose analytics and ML tools.
• Write optimized PySpark and structured SQL code within Delta Live Tables (DLT) and Databricks Workflows.
• Integrate data pipelines with Python frameworks like Streamlit, Dash, or Gradio hosted inside Databricks.
• Manage the CI/CD lifecycle of pipelines and apps using Databricks Asset Bundles (DABs) and Git.
• Optimize performance using Liquid Clustering and ensure security compliance via Unity Catalog.

Required Skills

• 5+ years of experience with Databricks platform and Apache Spark.
• Advanced Python skills (PySpark, Pandas) and structured SQL.
• Proven experience building web apps with Streamlit, Dash, or Gradio.
• Deep understanding of Delta Lake architecture, table optimization, and data layouts.
• Proficiency with Git, CI/CD pipelines, and Infrastructure-as-Code via Databricks Asset Bundles.
• Experience integrating production ML models served via MLflow endpoints.
• Bachelor's degree in a technical field.

Preferred Skills

• Databricks Certified Data Engineer Associate/Professional.
• Databricks Certified Developer.

Key Skills

Education

Bachelor's degree