← Back to jobs

American Technology Group LLC Logo
ETL SDET - PySpark Coding Experience

American Technology Group LLC

 

Jersey City, NJ, USA

Posted On: 1 day ago
Experience: 12+ years
Availability: Onsite
Openings: 1
Category: SDET
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will ensure the quality and reliability of ETL processes and data integration workflows.

This role is on-site.

Responsibilities

  • Design and implement automated tests to validate data transformation and migration.
  • Collaborate with data engineers and developers to resolve data quality issues.
  • Enhance overall data pipeline performance and integrity using ETL testing expertise.
  • Provide testing oversight within an Agile team structure.

Required Skills

  • 12+ years of IT experience, with 8+ years focused on ETL testing and automation.
  • Mandatory coding experience using Python and PySpark for test development.
  • Proficiency in developing automation frameworks and test cases in a scripting language.
  • Strong SQL skills, including writing complex queries for big data handling.
  • Experience testing in cloud environments, specifically AWS S3.
  • Experience working in a Big Data ecosystem processing data in a data lakehouse.
  • Familiarity with DevOps practices in ETL and Cloud environments.

Preferred Skills

  • Experience with Kafka or Shell Scripting.
  • Familiarity with DBT or similar data transformation tools.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs