Description

You will lead the migration of a critical data warehouse from GCP to Azure, owning the development of pipelines, transformations, and validation tools.

This role is on-site.

Responsibilities

• Develop and optimize data pipelines using Azure Data Factory, Azure Synapse, and AKS.
• Lead data migration efforts, implementing transformations for the transition from GCP to Azure.
• Convert and optimize SQL queries for the Azure environment to ensure performance.
• Build data validation tools to guarantee data integrity post-migration.
• Develop and integrate data APIs in Azure AKS and provide post-MVP support.

Required Skills

• 10+ years of experience with Python programming.
• 10+ years of experience in SQL for data manipulation and querying.
• 5+ years of hands-on experience with Azure cloud technologies, including Azure Data Factory, Azure Synapse, Event Hub, and AKS.
• Experience with Kafka and Spark for distributed data processing.
• Proven experience managing large-scale data migration projects in cloud environments.
• Experience working with GCP.

Preferred Skills

• Experience with GraphQL and REST API development.
• Knowledge of data microservices architecture.
• Proficiency in Shell scripting for task automation.

Key Skills

Education

Any Gradute