Description

You will design and manage data pipelines and infrastructure within the Azure ecosystem.

Responsibilities

• Build and maintain data pipelines, connections, and transformation processes in Azure.
• Execute data migrations, including moving data warehouses and pipelines from GCP to Azure.
• Develop new data APIs within Azure AKS.
• Perform query conversion and create new data validation tools.
• Handle performance tuning and documentation following MVP releases.

Required Skills

• 10+ years of experience with Python and SQL.
• 5+ years of experience working with AWS and Azure cloud environments.
• Hands-on experience with Azure Data Factory, Synapse, Event Hub, and AKS.
• Proficiency with distributed processing frameworks including Kafka, Spark, and Flink.
• Experience implementing REST APIs and GraphQL APIs.
• Ability to use shell scripting for automation.
• Experience with data microservices.
• Bachelor's degree or equivalent graduate level education.

Key Skills

Education

Any Gradute