Description

You will build and maintain data pipelines on the Azure platform.

This role is on-site.

Responsibilities

• Develop and optimize data workflows using Azure Data Factory (ADF).
• Engineer and manage data processing jobs within Azure Databricks using PySpark.
• Manage and govern data assets using Unity Catalog within Databricks.
• Develop and tune SQL queries and schemas for Azure SQL databases.
• Ensure data storage integrity and accessibility within Azure Data Lake Storage Gen2 (ADLS Gen2).

Required Skills

• 5+ years of overall experience working on the Azure Cloud Platform.
• 4+ years of hands-on experience with Azure Databricks and PySpark.
• 2+ years of experience specifically with Databricks Workflows and Unity Catalog.
• 3+ years of practical experience utilizing Azure Data Factory (ADF).
• 3+ years of experience managing Azure Data Lake Storage Gen2 (ADLS Gen2).
• 3+ years of experience in Azure SQL development and optimization.
• 2+ years of hands-on Python programming, including package/module development.

Key Skills

Education

Any Graduate