Description

Design and implement end-to-end data pipelines for large enterprise data warehouse applications.

Responsibilities

• Build and manage data workflows using Azure Data Factory and Databricks.
• Develop and maintain infrastructure using Terraform for automated provisioning.
• Implement CI/CD pipelines for automated deployments using GitHub and GitHub Actions.
• Create technical artifacts including application architecture and solution design documents.
• Implement ingestion, transformation, orchestration, and analytics solutions.

Required Skills

• 5+ years of experience in data engineering and solutioning.
• Proficiency in Python, PySpark, and SQL.
• Hands-on experience with Azure Data Factory, Azure Databricks, and Delta Lake.
• Experience with Azure Data Lake and Event Hub.
• Strong knowledge of Power BI for reporting and analytics.
• Experience with Git, GitHub, and GitHub Actions for version control and CI/CD.
• Competency in using Terraform for infrastructure as code.
• Experience working within Agile delivery frameworks and using Jira.
• Solid understanding of design and integration patterns.

Preferred Skills

• Experience working in the Retail domain.

Key Skills

Education

Any Graduate