Description

You will design, build, and maintain scalable data pipelines on the Azure platform.

This role is remote.

Responsibilities

• Build and support data pipelines using Azure Data Factory and Azure Databricks.
• Ingest, transform, and load data into the Azure Data Lake using Delta Tables.
• Implement data governance, access control, and metadata management via Databricks Unity Catalog.
• Monitor pipeline execution and troubleshoot data quality and performance issues.
• Conduct unit and system testing for data pipeline components within Agile workflows.

Required Skills

• 3+ years of hands-on experience with Databricks (certification required).
• 3+ years of experience building and supporting pipelines with Azure Data Factory.
• 5+ years of strong SQL development experience.
• Proficiency with Databricks-managed Delta Tables.
• Hands-on experience with unit and system testing of data pipelines.
• Understanding of data governance, metadata management, and access control.
• Strong verbal communication skills.

Preferred Skills

• Experience with Azure Data Lake storage structures.
• Knowledge of Agile development methodologies.

Key Skills

Education

Any Graduate