Description

You will build and optimize scalable data pipelines on Azure Databricks.

This role is on-site.

Responsibilities

• Manage Azure Databricks workspaces, clusters, and performance optimization.
• Build scalable data pipelines using PySpark and Spark SQL.
• Orchestrate end-to-end data workflows using Azure Data Factory and Synapse.
• Implement ETL/ELT processes with ADLS and Delta Lake.

Required Skills

• 5+ years experience with Azure Databricks and cluster management.
• Proficiency in PySpark and Spark DataFrames for data engineering.
• Strong Python and SQL programming skills.
• Experience with Azure Data Factory (ADF) and Synapse.
• Knowledge of Azure DevOps and CI/CD practices for Databricks.
• Understanding of distributed data processing and data warehousing concepts.

Preferred Skills

• Experience building reusable data frameworks.
• Knowledge of Git integration for deployment automation.

Bachelor’s degree or foreign equivalent required. Three years of progressive experience in the specialty may substitute for every year of education.

Key Skills

Education

Bachelor's degree