Description

You will build and manage data integration pipelines within the Azure Data Platform.

Responsibilities

• Develop and maintain data integration workflows using Azure Data Factory.
• Perform data wrangling and transformation using Python and PySpark.
• Manage large-scale, complex data volumes and processing tasks.
• Execute SQL development and data manipulation tasks.
• Work with Azure Synapse to process and integrate flat files.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Azure Data Platform and Azure Data Factory (ADF).
• Strong experience with Databricks and PySpark.
• Advanced Python programming skills.
• Extensive SQL development and data wrangling experience.
• Experience handling large data volumes and complex datasets.
• Hands-on experience with Azure Synapse and flat file processing.
• Bachelor’s Degree.

Key Skills

Education

Bachelor’s Degree