Description

Lead the migration of data assets from SAP HANA to Azure Lakehouse and Microsoft Fabric architectures.

This role is remote.

Responsibilities

• Design and maintain ETL/ELT pipelines using Azure Databricks, Delta Lake, and Parquet.
• Optimize query performance and cost management within Azure Data Lake Storage and Databricks.
• Implement data quality frameworks and monitoring solutions for accuracy and reliability.
• Integrate NPower solutions on top of the data lake to enable analytics and reporting.
• Document data workflows, architecture diagrams, and operational runbooks.

Required Skills

• 5+ years of data engineering experience with Azure data platform technologies.
• Hands-on expertise in Azure Databricks, including notebooks, jobs, and cluster management.
• Strong SQL skills with experience in data modeling and ETL/ELT development.
• Proficiency in Python or Scala.
• Experience with SAP HANA environments and migration strategies.
• Familiarity with Microsoft Fabric architecture and migration considerations.
• Understanding of Delta Lake and Parquet file formats.
• Solid grasp of data governance, security, and compliance.

Preferred Skills

• Azure certifications (Data Engineer Associate, Solutions Architect).
• Experience with infrastructure-as-code tools (Terraform, ARM templates).
• Knowledge of streaming technologies (Azure Event Hubs, Kafka) and containerization (Docker, Kubernetes).

Key Skills

Education

Bachelor's degree