Description

You will build and maintain data pipelines on Azure using ADF, SQL, and Databricks.

This role is on-site.

Responsibilities

• Develop data transformation logic using DataFlows, Linked Services, and Datasets in Azure Data Factory.
• Configure and manage ADF components including triggers, copy activities, and parametrization.
• Implement security protocols and manage integration with various data sources.
• Debug and troubleshoot pipeline failures and performance issues in Azure environments.
• Manage Azure Git configurations for version control and deployment.

Required Skills

• 8+ years of hands-on programming experience with Azure Data Factory (ADF).
• Strong proficiency in SQL for data manipulation and querying.
• Experience with Databricks for data processing and transformation.
• Knowledge of Azure storage options including Data Lake Storage and Blob Storage.
• Ability to create basic pipelines, triggers, and debug complex workflows.
• Understanding of Azure VM and Azure Portal basics.
• Experience with data integration, security, and troubleshooting.

Key Skills

Education

Any Graduate