Description

You will own data validation and pipeline testing for data engineering workflows.

This role is hybrid.

Responsibilities

• Execute heavy-weight testing comparable to development tasks.
• Validate data transformations implemented by other engineers.
• Operate within CI/CD pipelines using Azure DevOps.
• Review data engineering concepts and pipeline logic.

Required Skills

• 5+ years of relevant experience as an individual contributor.
• Strong proficiency in Python and PySpark.
• Experience with Azure Data Factory and Databricks.
• Solid knowledge of SQL for data validation.
• Familiarity with CI/CD pipeline implementation.
• Understanding of core data engineering concepts.

Key Skills

Education

Any Graduate