Description

You will lead the development and maintenance of data pipelines within an Enterprise Data Hub environment.

Responsibilities

• Build and develop medium to high complexity data pipelines for the Enterprise Data Hub.
• Manage production support for existing data workflows and cloud services.
• Implement data transformation processes using dbt and PySpark.
• Oversee deployment and integration through DevOps practices.

Required Skills

• 10+ years of professional experience in data engineering or related roles.
• Expertise in Azure Data Factory (ADF).
• Hands-on experience with Databricks and PySpark.
• Proficiency in Python for data processing.
• Experience with dbt for data transformation.
• Strong knowledge of Azure Cloud Services.
• Experience working with MS SQL Server, ADW, or related databases.
• Practical application of DevOps methodologies.
• Degree in any graduate field.

Key Skills

Education

Any Graduate