Description

You will ensure data integrity and quality across ETL/ELT pipelines and data transformation processes.

Responsibilities

• Develop and implement test cases for ETL/ELT pipelines, data transformations, and ingestion processes for structured and unstructured data.
• Perform data validation and execute manual or automated test cases to reconcile variances and data anomalies.
• Monitor and troubleshoot data issues, failures, and inconsistencies across the pipeline.
• Conduct root cause analysis for data-related defects and provide detailed reports to development teams.
• Execute regression testing and post-release validation to ensure new code changes do not impact existing functionality.
• Partner with Data Engineers, Analysts, and stakeholders to define quality requirements and document data validation rules.

Required Skills

• 5+ years of experience in data engineering, data testing, or quality assurance.
• Proficiency in SQL and data validation frameworks.
• Strong understanding of ETL/ELT processes, data modeling, and schema design.
• Experience with Python and Java.
• Hands-on experience with GCP data services, including BigQuery, Dataflow, Dataproc, and Cloud Storage.
• Solid understanding of software development and testing methodologies.
• Experience working within Agile and Waterfall project management methodologies.
• Ability to document defects accurately and perform detailed root cause analysis.

Preferred Skills

• Familiarity with automated testing frameworks for data such as Great Expectations or dbt tests.
• GCP or other relevant software testing certifications.

Key Skills

Education

Any Gradute