Description

Validate data integrity and pipeline accuracy within BigData environments.

Responsibilities

• Test data pipelines built with Spark to ensure processing accuracy.
• Execute manual testing and validation tasks using Jira for defect tracking.
• Write and maintain test scripts using Python or Java.
• Utilize Jupyter notebooks for data exploration and test execution.

Required Skills

• 5+ years of experience in QA engineering.
• Advanced SQL skills for complex data validation.
• Proficiency in Python or Java scripting.
• Hands-on experience with BigData technologies.
• Knowledge of data pipelines and Spark.
• Basic AWS cloud knowledge.
• Experience with manual testing processes.
• Proficiency with Jira.

Preferred Skills

• Understanding of Databricks.

Key Skills

Education

Any Graduate