Description

Design and develop scalable data pipelines and lakehouse architectures using Databricks and Azure.

This role is remote.

Responsibilities

• Design and build scalable data pipelines using Databricks and Azure Data Factory (ADF).
• Develop and optimize ETL/ELT workflows using PySpark and Python.
• Create robust data models using Star and Snowflake schemas.
• Implement modern lakehouse architectures with Delta Lake and Apache Iceberg.
• Leverage Databricks Genie and GitHub Copilot to accelerate development.

Required Skills

• 10+ years of Data Engineering experience.
• Proficiency in Databricks, including Workflows and SQL.
• Strong experience with Azure Data Factory (ADF).
• Hands-on skills in PySpark and Python.
• Proven track record in Data Modeling.
• Experience with Delta Lake and Apache Iceberg.
• Familiarity with Azure Cloud Technologies.

Preferred Skills

• Experience with Config-Driven Data Pipelines.
• Knowledge of Databricks Genie (Conversational AI).
• Understanding of Data Virtualization.

Key Skills

Education

Any Gradute