Description

Lead test automation and data engineering within an Agile squad supporting a large-scale Common Data Platform.

This role is on-site.

Responsibilities

• Design and maintain automated test frameworks and reusable components.
• Coordinate data quality assurance across ingestion, transformation, and delivery.
• Develop and maintain data pipelines using Spark and Airflow.
• Lead end-to-end automated testing strategies and ensure requirement traceability.
• Monitor pipelines, implement alerts, and troubleshoot issues.

Required Skills

• 7+ years of experience in test automation, data engineering, or software engineering.
• Bachelor's degree in Computer Science, Information Systems, or a related field.
• 2+ years with modern data stacks including S3, Spark, Airflow, and Lakehouse architectures.
• 2+ years with test automation tools such as Great Expectations, Lambda Test, Selenium, or Cucumber.
• Proficiency with SQL and data modeling concepts.
• Experience designing and managing ETL pipelines for structured, semi-structured, and unstructured data.
• Proficiency with AWS services including S3, EC2, Lambda, Data Pipeline, and CloudWatch.

Preferred Skills

• Experience building data pipelines using Spark on AWS cloud platforms.
• Knowledge of CI/CD automation tools and DevOps best practices.
• Experience coaching and mentoring technical teams.

Key Skills

Education

Bachelor's degree