← Back to jobs

StaffXpert LLC Logo
Senior Data Engineer

StaffXpert LLC

 

United States

Posted On: Just posted
Experience: 8+ years
Availability: Remote
Openings: 1
Category: Senior Data Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Key Responsibilities

Design, develop, and execute test plans, test cases, and testing strategies for enterprise data platforms and data integration solutions.

Perform end-to-end ETL/ELT validation to ensure data accuracy, completeness, transformation integrity, and reconciliation between source and target systems.

Develop and execute complex SQL queries for backend testing and data validation.

Validate large-scale data processing workflows using Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).

Conduct functional, integration, regression, system, and data quality testing across data pipelines and applications.

Verify batch processing, workflow execution, job scheduling, and dependency management within Unix/Linux environments.

Identify, document, track, and retest defects while working closely with developers, data engineers, business analysts, and stakeholders.

Create and maintain reusable testing assets and automation solutions to improve testing efficiency.

Participate in Agile ceremonies, including sprint planning, daily stand-ups, reviews, and retrospectives.

Required Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience.

8+ years of experience in software quality engineering, ETL testing, data validation, integration testing, or related areas.

Strong hands-on experience with SQL, including complex queries for source-to-target validation and data reconciliation.

Experience testing large-scale data platforms and ETL/ELT pipelines.

Proficiency with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).

Experience working with Hadoop ecosystem technologies, including Hadoop/HDFS and Hive.

Strong knowledge of Unix/Linux environments and enterprise job scheduling tools.

Solid understanding of data quality processes, data mappings, transformation logic, and reconciliation techniques.

Experience working within Agile/Scrum development environments.

Excellent analytical, troubleshooting, communication, and collaboration skills.

Preferred Qualifications

Experience with test automation frameworks and automated data validation processes.

Exposure to cloud-based data platforms and modern data engineering architectures.

Experience supporting enterprise-scale data transformation and analytics initiatives.

Consulting or client-facing project experience is a plus

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs