Description

Design and manage scalable data architecture and pipelines on Microsoft Azure for cloud-native and hybrid environments.

This role is on-site.

Responsibilities

• Lead development of data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Manage data lakes and structured storage solutions using Azure Data Lake Storage Gen2, ensuring efficient access and governance.
• Integrate data from diverse source systems, including ServiceNow and geospatial systems, using APIs, connectors, and custom scripts.
• Build and optimize data workflows using Python and SQL for cleansing, enrichment, and advanced analytics within Azure Databricks.
• Implement data governance practices, including metadata management, classification, lineage tracking, and compliance with FOIP/GDPR standards.

Required Skills

• 6+ years of experience in Data Engineering.
• Proficiency in SQL and Python.
• Hands-on experience with Azure Data Factory.
• Experience with Azure Databricks.
• Understanding of data governance principles and practices.
• Familiarity with data architecture concepts and collaboration with Data Architects.

Preferred Skills

• Bachelor's degree in a relevant field.
• Experience with Azure Synapse Analytics and Azure API Management.

Key Skills

Education

Bachelor's degree