Description

You will design data architecture and canonical models to standardize data products across complex engineering and analytics projects.

Responsibilities

• Document data specifications and business rules for acquisition, processing, and presentation.
• Design and execute data validation plans for solutions built on traditional and modern processing frameworks.
• Develop SQL, NoSQL, and Python scripts to verify data mapping and transformation rules during ETL phases.
• Collaborate with DevOps and infrastructure teams to build data quality regression suites.
• Manage and mentor junior data analysts to meet delivery and quality objectives.
• Partner with product managers and stakeholders to align data products with business use cases.

Required Skills

• 10+ years of experience in data management or data quality roles.
• 3+ years of experience leading a data team.
• Expertise in SQL, Python, and PySpark for data analysis and reconciliation.
• Experience designing data engineering and quality verification processes for complex projects.
• Proven ability to document data lineage and prepare test cases for all processing stages.
• Experience working in Agile environments and self-organizing teams.
• Degree in Mathematics, Computing, Engineering, or equivalent experience.

Preferred Skills

• Experience with Azure Data Platform and Azure DevOps.
• Exposure to Microsoft-based test tools such as MTM or Azure Test Plans.
• Experience planning non-functional testing including performance, load, and integration testing.

Key Skills

Education

Any Graduate