Description

You will own data migration projects within the Azure ecosystem, focusing on pipeline development and system reliability.

Responsibilities

• Develop and maintain data pipelines using Azure Databricks and PySpark.
• Execute data migration tasks and resolve complex technical issues through debugging.
• Perform code reviews and create test scripts to verify functionality.
• Write technical documentation for data processes and system architectures.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency with Azure Databricks and PySpark.
• Strong knowledge of Azure Data Factory.
• Advanced SQL skills for data manipulation and analysis.
• Hands-on experience with Jenkins and Qtests.
• Experience with automated testing workflows.
• Strong technical writing and documentation capabilities.

Preferred Skills

• Working knowledge of Python.

Key Skills

Education

Any Graduate