Description

You will build automation utilities to validate and reconcile large-scale datasets, managing ETL testing across on-premise and cloud environments.

Responsibilities

• Build test automation utilities for data reconciliation and validation using Python data science libraries.
• Develop and manage ETL testing processes across on-premise and cloud data sources.
• Write complex SQL queries to validate data integrity and accuracy.
• Manage and orchestrate cloud resources including AWS Glue, EC2, and Lambda.

Required Skills

• 10+ years of hands-on Python programming experience.
• 10+ years of experience developing data reconciliation validation utilities.
• 10+ years of experience performing ETL testing for various data sources.
• 8+ years of experience managing AWS Glue, EC2, and Lambda.
• Proficiency with Pandas, NumPy, and PySpark.
• Strong expertise in Big Data technologies.
• Advanced ability to write complex SQL queries.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Prior Quality Engineering (QE) experience.

Key Skills

Education

Any Graduate