Description

You will design and build scalable data pipelines using Azure services, focusing on API and streaming ingestion.

This role is on-site.

Responsibilities

• Design and implement secure data processing pipelines using Azure Data Factory and Azure Databricks.
• Build and manage data ingestion workflows via API and streaming methods.
• Develop and maintain NoSQL solutions using Azure Cosmos DB.
• Write and optimize complex SQL queries for data processing and storage.
• Utilize Azure Synapse Analytics to support data-driven decision-making.

Required Skills

• 5+ years of experience in data engineering.
• Expert knowledge of Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service.
• Proficiency with Big Data technologies including Spark, Kafka, and Hive.
• Advanced SQL skills for complex query optimization.
• Experience developing NoSQL solutions with Azure Cosmos DB.
• Understanding of Azure and AWS Cloud Infrastructure offerings.
• Degree in any graduate field.

Preferred Skills

• Working knowledge of Python.

Key Skills

Education

Any Graduate