Description

You will build and maintain data pipelines on the Azure cloud platform.

Responsibilities

• Orchestrate data workflows using Azure Data Factory pipelines and triggers.
• Develop and manage data processing jobs using Azure Databricks and PySpark.
• Design and optimize data models within Azure Synapse Analytics dedicated and serverless SQL pools.
• Manage data storage and lifecycle within Azure Data Lake Storage Gen2.
• Implement real-time data ingestion using Azure Event Hubs, Kafka, or Stream Analytics.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise with Azure Data Factory (ADF) for pipeline orchestration.
• Proficiency in Azure Databricks using PySpark and Delta Lake.
• Strong knowledge of Azure Synapse Analytics, including SQL pool management.
• Hands-on experience with Azure Data Lake Storage (ADLS Gen2).
• Experience integrating real-time data streams via Kafka or Event Hubs.
• Working knowledge of SQL for data modeling and querying.
• Familiarity with Azure Functions or Logic Apps for event-driven workflows.

Key Skills

Education

Any Graduate