← Back to jobs

Technology Management Solutions Logo
QA Automation Engineer
Posted On: Just posted
Experience: 5+ years
Availability: Hybrid
Openings: 1
Category: QA Automation Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Own automated data testing frameworks and validate data pipelines across Databricks environments.

This role is hybrid.

Responsibilities

  • Build automated test frameworks for data validation, including record-level comparison, schema checks, and reconciliation.
  • Execute source-to-target data validation using SQL and PySpark/Spark SQL.
  • Test data pipelines and validate source-to-target mappings within Databricks notebooks.
  • Investigate data discrepancies and generate automated test reports.
  • Apply CI/CD practices for data pipeline testing.

Required Skills

  • 5+ years of experience in QA automation with strong Python skills.
  • Hands-on experience with Databricks, including notebooks, Delta Lake, and Unity Catalog.
  • Proficient in SQL for data validation and complex queries.
  • Experience with PySpark and Spark SQL for data processing and testing.
  • Strong understanding of data validation techniques: schema validation, count validation, and column-level mismatch analysis.
  • Familiarity with CI/CD pipelines for data engineering workflows.

Preferred Skills

  • Experience testing vehicle data domains.

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs