Description

You will engineer and optimize data pipelines within the Azure ecosystem.

Responsibilities

• Build and manage data workflows using Azure Data Factory.
• Develop data processing logic using Scala and Apache Spark.
• Implement and manage Delta Architecture patterns for data storage.
• Optimize data performance through techniques like Partitioning and Bucketing.
• Handle large-scale data operations within the Azure environment.

Required Skills

• 8+ years of professional experience in data engineering.
• Expertise in Azure Data Factory.
• Proficiency with Azure Databricks.
• Strong command of Scala programming language.
• Experience utilizing Apache Spark for big data processing.
• Solid knowledge of SQL.
• Familiarity with Azure Data Lake Storage (ADLS).
• Experience implementing Delta Architecture.
• Possession of the Databricks Professional Certificate.

Key Skills

Education

Any Graduate