← Back to jobs

Avance Consulting Logo
Databricks Data Engineer

Avance Consulting

 

Maumee, OH, USA

Posted On: Just posted
Experience: 10+ years
Availability: Onsite
Openings: 1
Category: Databricks data engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

We are seeking an experienced Databricks Data Engineer with strong expertise in enterprise data engineering and hands-on experience in SAP S/4HANA data migration and data-load activities. The candidate will develop scalable data pipelines and leverage AI/GenAI techniques to support data transformation, quality, mapping, and reconciliation.

Key Responsibilities

Design and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake.

Develop ETL/ELT workflows using PySpark, Python, and SQL.

Extract, cleanse, transform, map, and validate data from SAP ECC, S/4HANA, legacy, and non-SAP systems.

Support SAP S/4HANA data migration, mock loads, reconciliation, cutover, and production migration.

Work with SAP master and transactional data, including Business Partner, Customer, Vendor, Material, Finance, Purchasing, and Sales.

Implement automated data-quality checks, reconciliation controls, logging, and exception handling.

Apply AI/ML and GenAI techniques for data mapping, enrichment, anomaly detection, entity matching, and transformation automation.

Optimize pipeline performance and maintain data lineage, security, and technical documentation.

Required Skills & Experience

Strong hands-on experience with Databricks, Apache Spark, and Delta Lake.

Proficiency in PySpark, Python, and SQL.

Experience in SAP S/4HANA migration, conversion, or data-load programs.

Expertise in source-to-target mapping, data cleansing, transformation, validation, and reconciliation.

Understanding of SAP master and transactional data structures.

Experience handling large-volume enterprise data and reusable ETL/ELT frameworks.

Working knowledge of AI/ML or GenAI applications in data engineering.

Strong analytical, problem-solving, and stakeholder-management skills.

Preferred Skills

Experience with SAP S/4HANA Migration Cockpit and migration objects.

Knowledge of SAP ECC to S/4HANA transformation.

Experience with Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.

Knowledge of Unity Catalog, data governance, lineage, and data-quality frameworks.

Experience using LLMs/GenAI for metadata analysis and transformation automation.

Functional exposure to SAP FI/CO, MM, or SD.

Experience in global SAP transformation programs involving multiple mock-load and cutover cycles

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs