Description

You will build and manage data pipelines within the Azure ecosystem.

Responsibilities

• Integrate, transform, and consolidate data from structured and unstructured sources.
• Implement Databricks notebooks using Python.
• Develop data workflows using Azure Data Factory and Azure Functions.
• Manage data storage and processing within ADLS, Synapse, and serverless architectures.

Required Skills

• 4+ years of experience with PySpark and Azure Databricks.
• Proficiency in Python for data engineering tasks.
• Strong experience with SQL or native SQL query languages.
• Hands-on experience with Azure Data Factory and ADLS.
• Experience with Azure Synapse and serverless architecture.
• Knowledge of Azure Functions and storage services.

Preferred Skills

• Experience with SSIS/ETL transformation processes and Azure DevOps CI/CD deployments.
• Microsoft Azure certifications, such as DP-203.

Key Skills

Education

Any Graduate