Description

You will build and maintain end-to-end data pipelines within the Azure ecosystem.

This role is on-site.

Responsibilities

• Develop end-to-end data pipelines from scratch.
• Build and manage ETL processes using Azure Data Factory (ADF) and Databricks.
• Implement unit testing to ensure data integrity and pipeline reliability.
• Operate within an Agile/Scrum development framework.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on experience with Azure Data Factory (ADF).
• Proficiency with Databricks.
• Experience with Azure DevOps and Blob storage.
• Knowledge of DataStage or similar ETL tools.
• Competency in Unix and Linux environments.
• Ability to write Shell Scripts.
• Experience working in Agile/Scrum environments.
• Practical knowledge of Unit Testing.

Preferred Skills

• Any graduate degree.

Key Skills

Education

Any gradudate