Description

You will support a critical data warehouse migration from GCP to Azure.

Responsibilities

• Develop and optimize new data pipelines using Azure Data Factory, Azure Synapse, and AKS.
• Lead data migration efforts and implement transformations for the transition from GCP to Azure.
• Convert and optimize queries for the Azure environment.
• Build data validation tools to ensure integrity post-migration.
• Develop and integrate data APIs in Azure AKS.
• Conduct performance tuning and provide post-MVP support and documentation.

Required Skills

• 10+ years of experience with Python programming.
• 10+ years of experience in SQL for data manipulation and querying.
• 5+ years of hands-on experience with Azure cloud technologies, including Azure Data Factory, Azure Synapse, Event Hub, and AKS.
• Experience with Kafka and Spark for distributed data processing.
• Proven experience managing large-scale data migration projects in cloud environments.
• Experience working with GCP.

Preferred Skills

• Experience with GraphQL and REST API development.
• Knowledge of data microservices architecture.
• Proficiency in Shell scripting for task automation.
• Microsoft Certified: Azure Data Engineer Associate.
• AWS Certified Solutions Architect.

Key Skills

Education

Any Gradute