Description

Validate data pipelines and transformations within a Big Data ecosystem.

Responsibilities

• Validate source and target data loads using complex SQL scripting across Oracle, AWS Redshift, and MS SQL Server.
• Test Big Data pipelines using Hadoop and Spark frameworks within AWS cloud infrastructure.
• Execute Black Box, Smoke, Functional, System Integration, End-to-End, Regression, and User Acceptance Testing (UAT).
• Perform Load, Performance, and Stress testing as required by project needs.
• Manage test cases and defect tracking using JIRA and Excel within Agile Scrum environments and participate in defect triaging.

Required Skills

• 5+ years of experience in software testing and data validation.
• Proficiency in MS SQL Server and complex SQL scripting.
• Hands-on experience with Spark DataFrame API and PySpark for data manipulation.
• Experience testing Big Data pipelines in AWS cloud environments using Hadoop/Spark.
• Strong understanding of SDLC and STLC methodologies.
• Proficiency with JIRA for defect management.
• Knowledge of Python for automation.
• Understanding of ETL processing, Data Warehouse architecture, and BI concepts.

Preferred Skills

• Experience with Python-based automated test scripts or TOSCA.
• Functional knowledge of Salesforce CRM or Oracle Eloqua.

Key Skills

Education

Any Gradute