Description

You will build and maintain end-to-end data pipelines on Azure.

This role is on-site.

Responsibilities

• Implement data pipelines using Azure Data Factory and Cosmos DB.
• Manage big data pipelines, including data validation and quality checks.
• Monitor deployed pipelines and analyze platform telemetry.
• Provide daily status updates and maintain technical specifications.
• Update wiki pages and documentation for all pipeline implementations.

Required Skills

• 5+ years of professional engineering experience.
• Proficiency in Python, Java, or Scala.
• Experience with Azure Data Factory and Azure Synapse Analytics.
• Working knowledge of Azure Data Lake and Azure Blob Storage.
• Familiarity with big data concepts and pipeline architectures.
• Experience with version control using ADO Git.
• Strong analytical thinking and problem-solving skills.
• Understanding of data quality checks and stream validation.

Key Skills

Education

Any Gradute