← Back to jobs

InnoMethods Corporation Logo
Big Data Engineer with Data and ETL QE Tools Experience

InnoMethods Corporation

 

Austin, TX, USA

Posted On: 2 days ago
Experience: 10+ years
Availability: Hybrid
Openings: 1
Category: BigData Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Develop test automation utilities for data reconciliation and validation, managing ETL testing processes across on-prem and cloud data sources.

This role is on-site.

Responsibilities

  • Execute complex SQL queries to validate data integrity.
  • Manage AWS resources including Glue, EC2, and Lambda.
  • Navigate the full testing life cycle for large-scale data environments.
  • Develop automation utilities for data reconciliation using Python data science libraries.

Required Skills

  • 10+ years of experience in the testing life cycle.
  • 10+ years of experience in ETL testing for on-prem and cloud data sources.
  • 10+ years of experience developing test automation utilities for data reconciliation.
  • 5+ years of hands-on Python programming experience.
  • 8+ years of experience managing AWS Glue, EC2, and Lambda.
  • Proficiency in Pandas, NumPy, and PySpark.
  • Hands-on experience with Big Data technologies.
  • Proficiency in writing complex SQL queries.

Preferred Skills

  • QE (Quality Engineering) experience.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs