Description

Key Skills: ETL, Databricks, Test Automation

Roles and Responsibilities:

• Develop and execute test plans for ETL pipelines, with emphasis on Databricks-based data processing.
• Validate data transformations, joins, aggregations, and load outcomes for correctness and consistency.
• Create test cases and test data to cover functional scenarios, edge cases, and failure conditions in ETL workflows.
• Perform regression testing for ETL changes and support release readiness for data pipeline deployments.
• Collaborate with data engineering teams to troubleshoot data issues and improve data quality through testing.

Skills Required:

• 5 - 10 years of experience in ETL testing and data pipeline quality assurance.
• ETL testing experience across end-to-end pipeline validation.
• Databricks ETL testing experience, including validation of Databricks jobs and workflows.
• Strong understanding of data correctness checks (row counts, schema validation, and transformation outcomes).
• Experience executing repeatable testing cycles for ETL releases and changes.

Good to Have:

• Automation Testing experience for ETL validation workflows.
• Experience with Data Bricks naming/usage in Databricks ETL contexts.

Education: Relevant degree in Computer Science, Engineering, or related field (or equivalent practical experience)

Key Skills

Education

Any Graduate