← Back to jobs

Trinity Technology Solutions Logo
Big Data Developer
Posted On: 4 days ago
Experience: 10+ years
Availability: Onsite
Openings: 1
Category: Bigdata Developer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will build automation utilities to validate and reconcile large-scale datasets, managing ETL testing across on-premise and cloud environments.

This role is on-site.

Responsibilities

  • Build test automation utilities for data reconciliation and validation using Python data science libraries.
  • Develop and manage ETL testing processes across on-premise and cloud data sources.
  • Write complex SQL queries to validate data integrity and accuracy.
  • Manage and orchestrate cloud resources including AWS Glue, EC2, and Lambda.

Required Skills

  • 10+ years of hands-on Python programming experience.
  • 10+ years of experience developing data reconciliation validation utilities.
  • 10+ years of experience performing ETL testing for various data sources.
  • 8+ years of experience managing AWS Glue, EC2, and Lambda.
  • Proficiency with Pandas, NumPy, and PySpark.
  • Strong expertise in Big Data technologies.
  • Advanced ability to write complex SQL queries.
  • Bachelor's degree or equivalent experience.

Preferred Skills

  • Prior Quality Engineering (QE) experience.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs