Description

You will build and maintain data pipelines using Azure Data Factory, Azure SQL, and ADLS Gen2.

This role is on-site.

Responsibilities

• Develop ADF activities including Copy, Lookup, For Each, and Stored Procedures with complex parameterization and dynamic expressions.
• Manage Linked Services and Datasets for Azure SQL and ADLS Gen2 integration.
• Write Python scripts for JSON configuration, generation, and data handling.
• Perform source-to-target data reconciliation using row counts, control totals, and hash comparisons.
• Manage Git version control and support CI/CD processes in Azure DevOps.

Required Skills

• 5+ years of experience with Azure Data Factory (ADF) development.
• Strong proficiency in Python for data processing and configuration.
• Experience with Azure SQL and ADLS Gen2.
• Hands-on experience with Git version control.
• Knowledge of Azure DevOps CI/CD pipelines.
• Understanding of datasets and ADF activities.

Preferred Skills

• Experience with Pentaho KJB/KTR structures.
• Familiarity with Azure Key Vault and Self-Hosted Integration Runtime.
• Understanding of ARM templates.

Key Skills

Education

Bachelor's degree