Description

You will own the design and implementation of data pipelines and warehousing solutions.

Responsibilities

• Design and build data solutions using Azure Data Services, including ADF, Synapse, and Data Lake Storage (Gen2).
• Develop and optimize ETL/ELT processes handling structured, semi-structured, and unstructured data.
• Implement data architecture patterns, differentiating between batch and stream processing (Lambda/Kappa).
• Manage data governance and security by applying principles like RBAC and managed identities.

Required Skills

• 14+ years overall experience in data engineering, data warehousing, or software development.
• 5+ years hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Data Lake Storage (Gen2).
• Strong proficiency in SQL, Python, PySpark, and T-SQL.
• Experience with data formats including JSON and Parquet.
• Expertise in cloud infrastructure as code using Terraform or ARM.
• Hands-on experience with CI/CD tools like Azure DevOps or GitHub Actions.
• Deep understanding of data architecture principles.
• Experience with modern data governance platforms such as Microsoft Purview.

Key Skills

Education

Any Graduate