Description

Lead end-to-end implementation of large-scale Data Lake and Data Warehouse solutions.

You will own the design and management of architectures for structured, semi-structured, and unstructured data. You will execute data modeling, metadata management, and master data management tasks. You will enforce data governance standards across all data pipelines. You will build and maintain ETL processes using Azure Data Factory and Azure Synapse.

Responsibilities

• Design and manage data lake and warehouse architectures.
• Execute data modeling and master data management.
• Enforce data governance standards across pipelines.
• Build and maintain ETL processes using Azure Data Factory and Azure Synapse.
• Manage structured, semi-structured, and unstructured data workflows.

Required Skills

• 8+ years of experience in data engineering.
• Extensive experience with Azure Databricks and PySpark.
• Proficiency in Python for data processing.
• Hands-on experience with Azure Data Lake and Azure Synapse.
• Experience with Azure Synapse dedicated SQL Pools.
• Strong knowledge of data modeling and ETL tools like ADF.
• Working knowledge of Java.

Preferred Skills

• Experience managing structured, semi-structured, and unstructured data.

Key Skills

Education

Not specified