Description

You will engineer and manage data pipelines within the Azure ecosystem.

Responsibilities

• Design large-scale data distribution and integration solutions, interfacing with service-oriented architecture or data warehouses.
• Develop and implement Data Lake solutions using Azure Databricks for handling multi-format, large-scale data.
• Translate working solution designs into functional, implementable packages utilizing the Azure platform.
• Manage and maintain data processes using Azure Data Factory and related Azure services.

Required Skills

• 8+ years of hands-on experience with the Azure stack.
• Expert proficiency in Python and PySpark for data transformation.
• Demonstrated experience with Azure Data Factory and Azure Databricks.
• Proficient coding experience using Spark (Scala or Python) and T-SQL.
• Solid understanding of Azure Storage Gen2.
• Familiarity with Azure Analytics, Azure SQL, Azure Function App, and Logic App services.
• Proven ability to manage multiple projects while maintaining high quality under pressure.

Key Skills

Education

Any Graduate