Description

You will build and maintain data pipelines using Python and Azure.

Responsibilities

• Design and develop efficient ETL workflows to extract, transform, and load data from various sources.
• Implement data governance frameworks and establish data quality standards across pipelines.
• Configure monitoring and alerting mechanisms for scheduled batch job execution.
• Manage data storage and infrastructure resources within the Azure cloud platform.

Required Skills

• 5+ years of experience in data engineering roles.
• Strong proficiency in Python and ETL process development.
• Hands-on experience with Microsoft Azure cloud platform architecture.
• Practical experience using Azure Data Factory for pipeline implementation.
• Proficiency with Databricks for data transformations and analytics.
• Experience managing Azure Storage and Azure Virtual Machines.
• Solid understanding of Data Governance principles and Data Quality management.

Key Skills

Education

Any Gradute