Description

You will engineer and manage large-scale data pipelines and integration solutions within the Azure ecosystem.

This role is on-site.

Responsibilities

• Design and implement data distribution and integration solutions interfacing with service-oriented architectures or data warehouses.
• Develop and maintain Data Lake solutions using Azure Databricks for multi-format, large-scale data processing.
• Translate solution designs into functional packages using the Azure platform.
• Manage and maintain data processes using Azure Data Factory and related Azure services.

Required Skills

• 8+ years of hands-on experience with the Azure stack.
• Expert proficiency in Python and PySpark for data transformation.
• Proven experience with Azure Data Factory and Azure Databricks.
• Proficient coding in Spark (Scala or Python) and T-SQL.
• Solid understanding of Azure Storage Gen2.
• Familiarity with Azure Analytics, Azure SQL, Azure Function App, and Logic App.

Preferred Skills

• Ability to manage multiple projects while maintaining high quality under pressure.

Key Skills

Education

Any Graduate