Description

You will build and maintain the data engineering and lakehouse infrastructure.

Responsibilities

• Build scalable ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Live Tables.
• Engineer curated datasets across bronze/silver/gold layers for claims, pricing, provider, RCM, and member data.
• Implement Delta Lake best practices, including ACID transactions, schema evolution, and CDC.
• Automate ingestion and transformation of large datasets from claims, provider, and EHR feeds.
• Collaborate with Data Analysts and Data Scientists to translate requirements into production data assets.

Required Skills

• 8+ years of Data Engineering experience, preferably in healthcare.
• Hands-on experience with Databricks, PySpark, SQL, and Delta Lake.
• Strong experience with Spark performance tuning.
• Experience engineering data for claims, provider, and membership domains.
• Strong understanding of healthcare data models and adjudication flows.
• Familiarity with Unity Catalog and governance guardrails for PHI compliance.
• Experience working in Agile ceremonies.
• Bachelor's degree.

Key Skills

Education

Bachelor’s degree