Description

You will build and optimize complex data pipelines within the Azure ecosystem.

Responsibilities

• Build and optimize complex data pipelines using Azure services.
• Develop data processing logic using Python and PySpark.
• Manage Azure infrastructure deployment via ARM templates.
• Maintain CI/CD workflows using GitLab and Azure DevOps.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python and PySpark.
• Strong SQL knowledge.
• Hands-on experience with Azure Databricks.
• Experience with Azure Data Factory and Synapse.
• Working knowledge of Azure Storage Account, Key Vault, and Active Directory.
• Experience with VMSS, Function apps, web apps, and Log analytics workspace.
• Understanding of Service principal, managed identity, ACR, and container instances.
• Knowledge of Azure networking services.

Preferred Skills

• Experience with infrastructure creation using ARM templates.
• Proficiency with GitLab and Azure DevOps.

Key Skills

Education

Any Graduate