Description

You will build and manage data pipelines within the Azure ecosystem.

Responsibilities

• Develop data processing workflows using Azure Databricks and PySpark.
• Manage data ingestion and orchestration via Azure Data Factory (ADF).
• Maintain data storage and organization within Azure Data Lake Gen2 and Delta Lake.
• Execute analytical workloads using Azure Synapse Analytics dedicated SQL pools.

Required Skills

• 5+ years of experience in data engineering roles.
• Expertise in Azure Databricks.
• Proficiency with Azure Data Factory (ADF).
• Experience with Azure Synapse Analytics (dedicated SQL pool).
• Hands-on experience with Azure Data Lake Gen2.
• Working knowledge of Delta Lake.
• Strong PySpark programming skills.
• Proficiency in SQL.
• Experience with Azure cloud technologies.

Preferred Skills

• Any graduate degree.

Key Skills

Education

any graduate