Description

You will design and implement complex ETL processes and data transformation flows within the Azure ecosystem.

Responsibilities

• Design and implement complex ETL and data process flows.
• Develop data transformation frameworks using Python and PySpark.
• Manage configuration, CI/CD, and cloud implementations on Azure.
• Analyze and interpret database execution plans to optimize performance.
• Maintain understanding of underlying storage, processing, and visualization systems.

Required Skills

• 5+ years of experience in data engineering.
• Expertise with Python and PySpark frameworks and libraries.
• Proficiency in Azure Data Factory (ADF).
• Experience with Azure Databricks (ADB).
• Strong SQL skills.
• Knowledge of Azure DevOps and CI/CD workflows.
• Experience with Azure cloud implementations and configuration management.
• Degree in any field of study.

Preferred Skills

• Azure certifications.

Key Skills

Education

Any Graduate