Description

You will ensure the quality and reliability of ETL processes and data integration workflows.

Responsibilities

• Design and implement automated tests to validate data transformation and migration.
• Collaborate with data engineers and developers to resolve data quality issues.
• Enhance overall data pipeline performance and integrity using ETL testing expertise.

Required Skills

• 12+ years of IT experience, with 8+ years focused on required skills.
• Proficiency in ETL Testing and developing automation frameworks/test cases in a scripting language.
• Mandatory coding experience using Python and PySpark.
• Strong SQL skills, including writing complex queries for big data handling.
• Experience testing in cloud environments, specifically AWS S3.
• Experience working in a Big Data ecosystem processing data in a data lakehouse.
• Familiarity with DevOps practices in ETL and Cloud environments.
• Ability to provide testing oversight within an Agile team structure.

Preferred Skills

• Experience with Kafka or Shell Scripting.
• Familiarity with DBT or similar data transformation tools.

Key Skills

Education

Any Graduate