Description

You will design and build integration jobs to move data from existing systems into Microsoft Cloud environments, owning the migration pipeline from source applications to Azure Data Lake, Azure SQL, and Azure DWH.

Responsibilities

• Design integration jobs to migrate data into Azure Data Lake, Azure SQL, and Azure DWH.
• Implement standard integration patterns using Azure Data Factory, Databricks, and Synapse.
• Manage code through CI/CD pipelines, branching strategies, and GIT.
• Execute work management within Azure DevOps using Agile/SAFe practices.
• Utilize job scheduling tools to maintain data workflows.

Required Skills

• 12+ years of data engineering experience.
• Azure Data Factory (ADF).
• Azure Databricks.
• Python, Spark SQL, and PySpark.
• Azure Synapse, Azure SQL, and Azure DWH.
• Azure Data Lake Storage and Analytics.
• Azure Database Migration Services.
• Experience with GIT, branching strategies, and CI/CD pipelines.
• Ability to navigate and comprehend mapping documents.

Preferred Skills

• Knowledge of MS SQL Server, MS SSIS, or IBM DataStage.

Key Skills

Education

Any Graduate