Description

You will engineer and optimize large-scale data pipelines within the Azure ecosystem.

This role is on-site.

Responsibilities

• Build and manage data workflows using Azure Data Factory.
• Develop data processing logic using Scala and Apache Spark.
• Implement and manage Delta Architecture patterns for data storage.
• Optimize data performance through partitioning and bucketing techniques.

Required Skills

• 8+ years of professional experience in data engineering.
• Expertise in Azure Data Factory.
• Proficiency with Azure Databricks.
• Strong command of Scala programming language.
• Experience utilizing Apache Spark for big data processing.
• Solid knowledge of SQL.
• Familiarity with Azure Data Lake Storage (ADLS).
• Experience implementing Delta Architecture.
• Databricks Professional Certificate.

Key Skills

Education

Any Graduate