Description

You will design and lead enterprise data solutions leveraging the Databricks platform.

This role is remote.

Responsibilities

• Engage with business stakeholders to translate goals and use cases into holistic Databricks solutions.
• Design scalable data lakehouse architectures using Delta Lake, Unity Catalog, and Delta Live Tables.
• Architect end-to-end data pipelines covering ingestion, transformation, storage, and cataloging.
• Enable data science and ML workflows on Databricks, designing end-to-end MLOps strategies.
• Lead customer-facing activities, including workshops, solution demos, and responses to RFPs.

Required Skills

• 8+ years of experience in solutions/enterprise architecture or senior data engineering.
• 3+ years of hands-on experience with the Databricks platform and Spark-based architectures.
• Deep expertise in Databricks components: Delta Lake, Unity Catalog, Databricks SQL, Delta Live Tables, and notebooks.
• Strong cloud experience with data services on AWS, Azure, or GCP.
• Proficiency in data integration and orchestration tools like Apache Airflow, dbt, Kafka, and Spark Structured Streaming.
• Advanced SQL and programming skills in Python or Scala.
• Experience delivering large-scale data lakehouse migrations and performance tuning.
• Familiarity with CI/CD implementation for data and ML pipelines.

Preferred Skills

• Experience with Databricks SQL and advanced notebook development.

Key Skills

Education

Bachelor's degree