Description

About the job

- Ensure data validation and integrity during migration and data pipeline workflows.

- ETL automation testing by validating end to end data pipelines.

- Automate workflows in AWS for scalability and performance optimization.

- Leverage CICD for continuous testing and deployment of data pipelines.

- Write complex SQL queries for debugging and data retrieval.

- Develop framework to support data testing for regression.

Qualification

-7+ years of experience in ETL/data testing, with hands-on exposure to

Databricks (Spark, Delta Lake, Notebooks).

- Strong SQL skills for writing validation queries, joins, aggregations, and data

comparisons.

- Experience testing pipelines on at least one cloud platform ? **AWS** (S3, Glue,

Redshift) or **Azure** (ADF, ADLS Gen2, Synapse).

- Understanding of **data warehousing concepts** (dimensional modeling, SCD types,

medallion/bronze-silver-gold architecture).

- Experience with test management tools (JIRA, TestRail, Azure DevOps, qTest, or

similar).

- Familiarity with **data quality/validation frameworks** and reconciliation techniques.

- Basic scripting skills in **Python or PySpark** for test automation.

- Understanding of **batch and streaming** data pipeline concepts.

- Strong analytical skills with high attention to detail.

- Good communication skills to document and articulate defects and testing outcomes

clearly.

Requirements added by the job poster

• 2+ years of work experience with Python (Programming Language)

• 4+ years of work experience with ETL Testing

Key Skills

Education

Any Graduate