Description

You will own the execution-heavy data validation and pipeline testing lifecycle for data engineering projects.

This role is hybrid.

Responsibilities

• Validate data transformations built by other engineers.
• Execute heavy-weight testing that mirrors development work.
• Test data validation logic and data pipelines.
• Review data engineering concepts and pipeline implementations.

Required Skills

• 7+ years of hands-on technical experience as an individual contributor.
• Proficiency with PySpark and Python for coding tasks.
• Experience with Azure Data Factory.
• Hands-on knowledge of Azure Databricks.
• Strong SQL skills for data validation.
• Experience with Data Pipeline Testing.
• Familiarity with Azure DevOps for CI/CD pipelines.
• Understanding of core data engineering concepts.

Preferred Skills

• Slight team lead experience is a plus for future scaling.

Key Skills

Education

Any Graduate