Description

You will lead data engineering and validation efforts for large-scale migration projects.

Responsibilities

• Architect and implement automated validation frameworks using Azure-native tools.
• Develop ETL/ELT processes following industry best practices.
• Perform data validation, reconciliation, and integrity checks across diverse data sources.
• Automate data validation workflows using Python scripting.
• Lead technical troubleshooting and analytical problem-solving for complex data pipelines.

Required Skills

• 10+ years of experience in Data Engineering and Data Validation for migration projects.
• Proficiency with Azure Data Factory (ADF), Azure Synapse, Databricks, and PySpark.
• Hands-on experience with Oracle, SQL Server, PostgreSQL, and MongoDB.
• Expertise in Azure Storage and Azure Functions.
• Experience with commercial Data Validation tools such as Datagap or Querysurge.
• Strong Python scripting skills for automation.
• Advanced knowledge of ETL and ELT architecture.
• Any Graduate degree.

Key Skills

Education

Any Graduate