Description

Build data pipelines and implement validation logic within the Azure ecosystem.

Responsibilities

• Build data pipelines using Azure Data Factory (ADF).
• Write PySpark scripts to perform data validation.
• Develop data processing workflows using Python.
• Maintain and optimize existing ETL processes.

Required Skills

• 4+ years of professional experience in data engineering.
• Hands-on experience with Azure Data Factory (ADF).
• Proficiency in Python for data processing.
• Experience writing PySpark scripts for data validation.
• Strong understanding of PySpark architecture and optimization.
• Any Graduate degree.

Key Skills

Education

Any Graduate