Description

You will build and deploy data engineering workloads on Azure cloud infrastructure.

This role is on-site.

Responsibilities

• Understand data ingestion and cloud data engineering requirements by collaborating with business lines.
• Translate requirements into cloud/on-prem data engineering designs and develop them using Databricks and ADF pipelines.
• Implement the medallion architecture across the Azure data lake for appropriate data zoning.
• Develop and deploy data engineering workloads in Databricks on Azure, monitoring performance, security, and scalability.
• Collaborate in multi-disciplinary Agile teams to code and scale applications in multi-cloud environments.

Required Skills

• 5+ years of experience developing Databricks and Azure Data Factory pipelines.
• Strong hands-on skills in Databricks Pipelines and ADF Pipelines.
• Experience following the medallion architecture pattern in Azure Data Lake.
• Familiarity with Agile methodology and team collaboration.
• Experience coding and scaling applications in multi-cloud and on-premises integrations.
• Ability to monitor and manage the performance and operational risks of cloud resources.

Key Skills

Education

Any Graduate