Description

Own end-to-end data quality for ETL/ELT pipelines through automated validation and testing.

This role is on-site.

Responsibilities

• Perform end-to-end data validation across ETL/ELT pipelines, ensuring accuracy, completeness, and consistency.
• Develop and maintain automated testing frameworks using Python, SQL, and PySpark.
• Execute source-to-target, transformation, and regression testing for data workflows.
• Integrate data validation checks into CI/CD pipelines using Azure DevOps, Jenkins, or GitLab.
• Troubleshoot and resolve data quality issues identified during testing phases.

Required Skills

• 5-7 years of experience in Data QA, ETL Testing, or Data Engineering QA.
• Strong expertise in Python and SQL for data manipulation and testing.
• Hands-on experience with PySpark for large-scale data processing and validation.
• Proven track record in ETL/ELT testing and data validation methodologies.
• Experience with CI/CD tools such as Azure DevOps, Jenkins, or GitLab.
• Familiarity with Airflow for workflow orchestration.
• Any Graduate degree.

Key Skills

Education

Any Graduate