Description

You will build and maintain end-to-end data pipelines within the Azure ecosystem.

Responsibilities

• Implement end-to-end data pipelines using Azure Data Factory and Cosmos DB.
• Create, maintain, and enhance Big Data pipelines for product telemetry and marketing campaign data.
• Perform data validation and quality checks on new data streams.
• Monitor existing Azure Data Factory pipelines and update technical specifications or wiki documentation.
• Manage version control via ADO Git and participate in CI/CD workflows.

Required Skills

• 5+ years of experience in Data Engineering.
• Proficiency with PySpark and Synapse.
• Hands-on experience with Azure Data Factory, Azure Data Lake, and Azure Data Lake Storage.
• Working knowledge of the MSBI stack on Azure.
• Experience with Azure Blob, Azure Functions, and Azure SQL.
• Technical proficiency in Python, Java, or Scala.
• Experience with Snowflake and PowerBI for data visualization.
• Ability to perform requirement analysis and technical documentation.

Preferred Skills

• Experience with product telemetry and marketing campaign data platforms.

Key Skills

Education

Any Gradute