Description

Own data warehouse quality engineering and development using Azure Databricks, PySpark, and SQL.

This role is hybrid.

Responsibilities

• Design and execute source-to-target comparison test cases for data warehouse migrations and ETL processes.
• Develop and maintain test artifacts including Test Plans, Test Cases, Traceability Matrices, and Closure Reports.
• Build and optimize data pipelines using PySpark and SQL within the Azure Cloud ecosystem.
• Collaborate in Agile (Scrum/Kanban) environments to resolve complex data quality issues in a scalable manner.
• Automate testing and deployment workflows using Azure DevOps and GitHub.

Required Skills

• 6+ years of experience in Data Warehouse Testing or Development.
• 2+ years of hands-on experience with Azure Cloud technologies.
• Expert proficiency in SQL, including complex query writing and validation logic.
• Strong experience with PySpark and Python for data processing and testing.
• Proficiency with Azure Databricks, Azure Data Factory, and Azure DevOps.
• Experience with version control (GitHub) and issue tracking (JIRA).
• Understanding of Data Marts, Data Warehouse concepts, and ETL processes.

Preferred Skills

• Microsoft Certified: DP-203 (Azure Data Engineer Associate) or DP-900.
• Knowledge of legacy systems including Mainframe, EBCDIC, COBOL, and Copybooks.

Key Skills

Education

Any Graduate