Description

You will build and manage data pipelines to support migrations from on-premises systems to Microsoft Azure.

Responsibilities

• Build data pipelines for on-premises to Microsoft Azure cloud migration using serverless compute functions.
• Create pipelines in Azure Data Factory using Linked Services, Datasets, and Pipelines to extract, transform, and load data.
• Integrate data from multiple sources including Azure SQL, Blob storage, and Azure SQL Data warehouse.
• Perform data cleaning, feature scaling, and feature engineering using Python.
• Optimize datasets and big data architectures.

Required Skills

• 5+ years of professional experience.
• Python proficiency with pandas and NumPy packages.
• Experience with Microsoft Azure cloud environments.
• Azure Data Factory (ADF) expertise.
• Azure SQL and Azure SQL Data warehouse.
• Azure Blob storage.
• Ability to build and optimize big data pipelines.

Preferred Skills

• Bachelor's degree in Computer Science, Engineering, Technology, or a related field.

Key Skills

Education

Any Graduate