Description

Design, build, and maintain scalable data pipelines and ETL processes on Azure.

This role is hybrid.

Responsibilities

• Develop and implement data pipelines to extract, transform, and load data from diverse sources into Azure services.
• Orchestrate data workflows and movement using Azure Data Factory or Azure Databricks.
• Build, test, and deploy data assets based on tasks and user stories within Azure DevOps.
• Design and implement CI/CD pipelines for software development teams.
• Handle break/fix issues, monitor jobs, and participate in a rotational on-call schedule.

Required Skills

• 10+ years of professional experience in data engineering.
• Expertise in end-to-end ETL cycles using Azure Data Factory (ADF) or Azure Databricks (ADB).
• Proficiency with PySpark and Python for complex data transformations.
• Experience integrating REST APIs and databases (Oracle, etc.) into Azure SQL or Azure SQL Database.
• Strong familiarity with ADLS, SQL, and SQL Server.
• Working knowledge of SAFe/Scrum Agile frameworks.
• Experience with Azure DevOps for CI/CD processes.

Preferred Skills

• Contributing to operational and architectural documentation.

Key Skills

Education

Any Graduate