Description

You will build and maintain data pipelines within the Azure ecosystem.

Responsibilities

• Develop end-to-end data pipelines from scratch.
• Build and manage ETL processes using ADF and Databricks.
• Implement unit testing to ensure data integrity and pipeline reliability.
• Operate within an Agile/Scrum development framework.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on experience with Azure Data Factory (ADF).
• Proficiency with Databricks.
• Experience with Azure DevOps and Blob storage.
• Knowledge of DataStage or similar ETL tools.
• Competency in Unix and Linux environments.
• Ability to write Shell Scripts.
• Experience working in Agile/Scrum environments.
• Practical knowledge of Unit Testing.

Key Skills

Education

Any gradudate