Description

You will be a Senior Data Engineer responsible for building and maintaining data pipelines on the Azure platform.

Responsibilities

• Develop and optimize data workflows using Azure Data Factory (ADF).
• Engineer and manage data processing jobs within Azure Data Bricks using PySpark.
• Manage and govern data assets using Unity Catalog within Data Bricks.
• Develop and tune SQL queries and schemas for Azure SQL databases.
• Ensure data storage integrity and accessibility within Azure Data Lake Storage Gen2 (ADLS Gen2).

Required Skills

• 5+ years of overall experience working on the Azure Cloud Platform.
• 4+ years of hands-on experience with Azure Data Bricks and PySpark.
• 2+ years of experience specifically with Data Bricks Workflows and Unity Catalog.
• 3+ years of practical experience utilizing Azure Data Factory (ADF).
• 3+ years of experience managing Azure Data Lake Storage Gen2 (ADLS Gen2).
• 3+ years of experience in Azure SQL development and optimization.
• 2+ years of hands-on Python programming, including package/module development.
• Proficiency in Azure Data Bricks, PySpark, ADF, Azure Data Lake, Azure SQL, and Python.

Key Skills

Education

Any Graduate