Description

You will test and validate ETL processes and data pipelines.

This role is hybrid.

Responsibilities

• Test ETL pipelines built with PySpark and AWS Glue jobs.
• Validate data scenarios using medium-complexity SQL queries.
• Use Unix to generate test data and automate testing routines.
• Apply data warehousing concepts to ensure data integrity.
• Own the end-to-end testing of ETL workflows.

Required Skills

• 5+ years of experience in ETL testing.
• Strong proficiency in Python.
• Hands-on experience with PySpark.
• Experience with AWS Glue jobs.
• Strong SQL skills for data validation.
• Proficiency in Unix for data creation and automation.
• Familiarity with general ETL processes.

Preferred Skills

• Any Graduate.

Key Skills

Education

Any Graduate