Description

Validate ETL pipelines end-to-end, ensuring data accuracy and quality from source to target.

This role is remote.

Responsibilities

• Write SQL queries to test transformations and verify data accuracy across large datasets.
• Perform data quality checks, including validation of counts, nulls, and duplicates.
• Build Python-based automation scripts to streamline pipeline validation.
• Test ETL pipelines within Azure environments, including ADF, Data Lake, and Azure SQL.
• Track defects and support issue resolution throughout the testing lifecycle.

Required Skills

• 5+ years of experience in ETL or backend data testing.
• Strong proficiency in SQL for large dataset validation.
• Experience with Python for test automation.
• Hands-on experience with Azure services: Azure Data Factory (ADF), Azure Data Lake, and Azure SQL.
• Deep understanding of ETL pipeline and data model testing, including SCD and star schema.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• Experience with data modeling concepts like star schema and slowly changing dimensions (SCD).

Key Skills

Education

Bachelor's degree