Description

You will design and manage data pipelines and infrastructure within the Azure ecosystem, including migrating workloads from GCP.

This role is on-site.

Responsibilities

• Build and maintain data pipelines, connections, and transformation processes in Azure.
• Execute data migrations, moving data warehouses and pipelines from GCP to Azure.
• Develop new data APIs within Azure AKS and implement REST/GraphQL APIs.
• Perform query conversion and create data validation tools.
• Handle performance tuning and documentation following MVP releases.

Required Skills

• 10+ years of experience with Python and SQL.
• 5+ years of experience working with AWS and Azure cloud environments.
• Hands-on experience with Azure Data Factory, Synapse, Event Hub, and AKS.
• Proficiency with distributed processing frameworks including Kafka, Spark, and Flink.
• Experience implementing REST APIs and GraphQL APIs.
• Ability to use shell scripting for automation.
• Experience with data microservices.

Preferred Skills

• Bachelor's degree or equivalent graduate level education.

Key Skills

Education

Any Gradute