Description

• We are seeking a highly skilled Senior ETL / Big Data Test Engineer with strong expertise in Data Validation, ETL Testing, and Test Automation.
• The candidate will be responsible for end-to-end testing across complex data pipelines, ensuring data integrity, quality, and seamless integration across multiple systems.
• The ideal candidate should possess a blend of functional testing, automation, SQL expertise, and stakeholder management, along with exposure to modern cloud-based data technologies.

Essential Job Functions:
ETL & Data Testing

• Perform end-to-end ETL testing across complex data pipelines.
• Validate data extraction, transformation, and loading (ETL) processes.
• Ensure data accuracy, completeness, and consistency.
• Conduct data reconciliation and cross-system validation.

Test Design & Execution

• Analyze business requirements and convert them into test scenarios and test cases.
• Design comprehensive, risk-based test strategies aligned with acceptance criteria.
• Lead:
  • Functional Testing
  • Integration Testing
  • Regression Testing
• Ensure optimal test coverage across releases.

Automation & Framework Development

• Develop and maintain ETL automation frameworks using:
  • Python
  • PySpark
  • Pandas
• Build reusable data validation scripts and utilities.
• Improve automation coverage to reduce manual testing efforts.

SQL & Data Validation

• Write and execute complex SQL queries for backend validation.
• Validate:
  • Data Transformations
  • Aggregations
  • Joins
  • Business Rules
• Perform detailed root cause analysis for data-related defects.

BI & Reporting Validation

• Perform BI and report testing.
• Validate dashboards, reports, and KPIs.
• Ensure data consistency between source systems and reporting layers.

Integration & API Testing

• Validate data flow across integrated systems.
• Perform API testing using tools such as Postman (preferred).

Defect Management

• Manage the complete defect lifecycle:
  • Identification
  • Logging
  • Prioritization
  • Tracking
  • Closure
• Work closely with development and integration teams to resolve issues.

Test Tracking & Reporting

• Track testing progress and coverage.
• Prepare quality metrics and status reports.
• Communicate:
  • Risks
  • Dependencies
  • Blockers
  • Overall Test Status

Stakeholder Collaboration

• Collaborate with:
  • Developers
  • Business Analysts
  • Product Owners
  • Business Users
• Ensure alignment on quality objectives and project timelines.

Risk & Quality Management

• Identify testing risks proactively.
• Drive mitigation strategies.
• Ensure compliance with QA standards, processes, and governance.

Team Contribution

• Mentor junior team members.
• Share technical knowledge and best practices.
• Foster a collaborative and high-performance team culture.

Communication & Adaptability

• Demonstrate excellent written and verbal communication skills.
• Adapt quickly to changing priorities and dynamic project environments.

Qualifications:

• Experience: 8–10 Years

Testing Expertise

• ETL Testing
• Big Data Testing
• Manual Testing
• BI / Report Testing
• End-to-End Testing
• Data Validation
• Data Reconciliation

Programming & Automation

• Python
• PySpark
• Pandas

Database Skills

• Advanced SQL
• Backend Data Validation
• Query Optimization

Cloud & Data Technologies

• Azure DevOps
• Azure Data Factory (ADF)
• Azure Databricks
• Azure Data Lake Gen2
• ETL Frameworks & Processes

Additional Skills

• Test Strategy & Test Planning
• Defect Management
• Risk-Based Testing
• Strong Analytical & Problem-Solving Skills
• Excellent Communication & Stakeholder Management

Preferred Skills

• API Testing using Postman
• Experience with modern cloud-based data platforms.
• Exposure to automation best practices and CI/CD environments.

Educational Qualification

• Bachelor's or Master's Degree in:
  • Computer Science
  • Information Technology
  • Data Engineering
  • Or a related discipline

Key Skills

Education

Bachelor's or Master's degrees