Description

Design and maintain CI/CD pipelines for Azure Synapse and Azure Data Factory, managing infrastructure as code and platform operations.

This role is hybrid.

Responsibilities

• Implement CI/CD pipelines using Azure DevOps or GitHub Actions for deploying data pipelines and infrastructure changes.
• Provision and manage Azure data services (Synapse, ADF, ADLS) via Terraform, ARM templates, or Bicep to ensure consistency.
• Deploy and optimize Azure data services, monitoring and troubleshooting pipeline failures and performance issues.
• Automate operational tasks using Python, PowerShell, or Bash scripts.
• Collaborate with data engineers to translate requirements into technical solutions and maintain security best practices.

Required Skills

• 4+ years of experience developing and integrating APIs, including 3rd party integrations.
• Strong SQL skills (SQL Server or Oracle) and proficiency in Python, Bash, or PowerShell.
• Deep knowledge of Azure Synapse Analytics and Azure Data Factory.
• Experience with version control systems (Git, GitHub, GitLab) and CI/CD best practices.
• Proficiency in Infrastructure as Code tools: Terraform, Bicep, or ARM templates.
• Understanding of ETL/ELT processes, data modeling, and data warehousing concepts.
• Familiarity with Azure AD, OAuth, JWT, and containerization (AKS, Docker).

Preferred Skills

• Microsoft Certified: Azure Data Engineer Associate (DP-203) or Azure DevOps Engineer Expert (AZ-400).
• Experience with Jenkins, GitLab CI/CD, or custom GitLab to GitHub adapters.

Key Skills

Education

Any Graduate