Description

You will design, build, and deploy interactive data applications and analytics pipelines on the Databricks platform.

This role is on-site.

Responsibilities

• Develop custom web applications and data UIs using Databricks Apps, Streamlit, Dash, or Gradio to expose analytics to business users.
• Write modular, optimized PySpark and structured SQL code within Delta Live Tables (DLT) and Databricks Workflows.
• Integrate data pipelines with Python-based application frameworks, managing state and API interactions securely.
• Optimize code execution, query structures, and file layouts using features like Liquid Clustering.
• Manage the CI/CD lifecycle for pipelines and applications using Databricks Asset Bundles (DABs) and Git.

Required Skills

• Deep development experience within the Databricks platform and Apache Spark framework.
• Advanced programming skills in Python (PySpark, Pandas) and highly structured SQL.
• Proven experience building web applications using Streamlit, Dash, or Gradio.
• Solid understanding of Delta Lake architecture, table optimization, and dynamic data layouts.
• Proficiency with Git, CI/CD pipelines, and infrastructure-as-code deployment via Databricks Asset Bundles.
• Experience ensuring applications conform to governance and security policies via Unity Catalog.
• Bachelor's degree in a relevant field.
• 5+ years of professional experience.

Preferred Skills

• Databricks Certified Data Engineer Associate or Professional certification.
• Experience building application interfaces that interact with production ML models served via MLflow endpoints.

Key Skills

Education

Bachelor's degree