Description

You will design, implement, and maintain scalable data architectures on the Databricks platform, focusing heavily on SAP data structures, especially master data.

Responsibilities

• Design end-to-end data architectures leveraging the Databricks Lakehouse Platform (Delta Lake, Unity Catalog).
• Develop scalable ingestion and transformation patterns for SAP data (ECC/S4, BW, etc.).
• Manage workspace configuration, clusters, and access control for the Databricks platform.
• Implement governance frameworks covering data quality, lineage, and master data validation.
• Review developer code, focusing on query optimization and efficient Delta Lake operations.

Required Skills

• 8+ years in data engineering or architecture, with 3-5+ years specifically in Databricks.
• Deep knowledge of PySpark, Spark SQL, and Delta Lake.
• Experience architecting solutions on Azure, AWS, or GCP.
• Strong experience extracting data from SAP ECC/S4/BW, understanding SAP tables and master data.
• Proficiency with Git, Azure DevOps, or GitHub Actions for CI/CD.
• Expertise in master data modeling, data quality frameworks, and metadata management.
• Ability to define logical and physical data models aligned with business processes.
• Familiarity with SQL and data pipeline orchestration (Databricks Workflows/Jobs).

Key Skills

Education

Any Graduate