Description

You will design and build data pipelines and transformation scripts for on-premises to Azure cloud migration.

Responsibilities

• Create technical specification documents for data engineering projects.
• Build pipelines to copy data from on-premises SQL Server to Azure Cosmos DB and Azure SQL.
• Develop data transformation scripts using Azure Databricks and Python.
• Write JSON code to create custom linked services and datasets in Azure Data Factory.
• Create scripts using Azure CLI to copy documents from local servers to Azure Blob Storage.

Required Skills

• 5+ years of experience as a Data Engineer, Tech Lead, or related role.
• Strong proficiency in SQL Server and Azure SQL for data handling.
• Experience with Azure Cosmos DB and Azure Blob Storage.
• Hands-on experience with Azure Databricks and Python for data transformation.
• Proficiency in developing JSON configurations for Azure Data Factory.
• Ability to write and execute SQL queries for QA testing and data validation.
• Experience using Azure CLI for automated data copying tasks.

Preferred Skills

• Master’s degree in Computer Science & Engineering or related field (Bachelor’s with 5+ years of experience is accepted).

Key Skills

Education

Any Graduate