Description

Lead the architecture and migration of enterprise data quality, MDM, and integration workloads from SAS DataFlux to the Databricks Lakehouse Platform.

This role is on-site.

Responsibilities

• Define target-state architecture, migration roadmaps, and gap analysis for SAS DataFlux to Databricks transformation.
• Design scalable solutions using Databricks, Delta Lake, Unity Catalog, DLT, and Medallion Architecture.
• Partner with Enterprise Architecture and Security teams to ensure RBAC, lineage, metadata, and PII compliance.
• Lead technical design reviews and enforce engineering standards for onshore and offshore teams.
• Build high-performance data quality, matching, deduplication, and MDM solutions using PySpark and Spark SQL.

Required Skills

• 10+ years of enterprise data architecture experience.
• 5+ years of hands-on expertise with SAS DataFlux (dfPower Studio, Data Management Studio, Data Management Server).
• Strong PySpark and Spark SQL development skills.
• Proven experience with Databricks, Delta Lake, Unity Catalog, Delta Live Tables, and Workflows.
• Domain knowledge in MDM: Customer, Product, Vendor, Employee, Location, and Reference Data.
• Experience with cloud platforms: Azure, AWS, or GCP.
• Understanding of Data Quality, Governance, Data Modeling (3NF, Dimensional, Data Vault), and Metadata Management.

Preferred Skills

• Experience leading DataFlux modernization or sunset programs.
• Databricks certifications.
• Experience in Healthcare, Insurance, or Financial Services domains.

Key Skills

Education

Any Graduate