Description

Architect and govern enterprise data platforms on Databricks Lakehouse, defining medallion architectures, canonical models, and end-to-end ingestion and transformation standards.

This role is hybrid.

Responsibilities

• Design medallion architecture and canonical data models.
• Define standards for data ingestion, transformation, orchestration, and CI/CD pipelines.
• Architect event-driven ingestion workflows using AWS EventBridge.
• Ensure data governance, lineage tracking, and cost optimization across the lakehouse.
• Guide Spark and Delta performance tuning best practices.

Required Skills

• 12+ years of experience with Databricks Lakehouse, Delta Lake, Unity Catalog, and Workflows.
• Strong AWS architecture skills, specifically S3, IAM, and EventBridge.
• Deep expertise in Spark performance tuning.
• Proficiency in using AI coding copilots (GitHub Copilot, ChatGPT) for code generation, debugging, optimization, and documentation.

Preferred Skills

• Healthcare domain exposure including Quality measures, Risk Adjustment (HCC/RAF), and HEDIS.
• Exposure to FHIR/HL7 data models and patient/member/provider entities.
• Experience with HealthLake architecture and streaming data architectures.

Key Skills

Education

Any Graduate