Description

You will design, develop, and optimize scalable data pipelines using Databricks and Azure Data Factory.

This role is remote.

Responsibilities

• Design and build Spark-based data transformation solutions for enterprise data platforms.
• Ingest and transform data into Azure Data Lake, managing it via Unity Catalog and Delta Tables.
• Develop and support Power BI datasets, reports, dashboards, and semantic models.
• Perform unit, integration, and system testing to ensure data quality and troubleshoot pipeline issues.
• Mentor team members, lead technical discussions, and drive engineering best practices within Agile ceremonies.

Required Skills

• 5+ years of experience with Databricks (Certification Required).
• 5+ years of experience with Azure Data Factory (ADF).
• 5+ years of strong SQL development.
• 3+ years of Power BI development experience, including dashboards, reports, and semantic models.
• Strong Spark programming skills.
• Hands-on experience with Azure Data Lake, Unity Catalog, and Delta Tables.
• Proven technical leadership and mentoring experience.

Preferred Skills

• Azure Cloud certifications.
• Experience with CI/CD and DevOps for Data Engineering.
• Background in enterprise data platform experience, data governance, security, and data quality.

Key Skills

Education

Bachelor's degree