Description

You will design, develop, and optimize end-to-end data pipelines to support healthcare analytics and operational reporting.

Responsibilities

• Design and deploy ETL pipelines using Databricks and Apache Spark to extract data from Epic EMR and other healthcare systems.
• Build reusable, scalable, and secure pipelines for analytics, dashboards, and real-time reporting.
• Collaborate with data engineers, analysts, and clinical informaticists to define data requirements.
• Optimize Spark cluster performance and data processing jobs for efficiency and cost management.
• Ensure data governance and security compliance according to HIPAA and healthcare regulations.

Required Skills

• 5+ years of experience building data pipelines using Databricks and Apache Spark.
• 3+ years of hands-on experience working with Epic EMR data including Clarity, Caboodle, FHIR APIs, and HL7.
• 5+ years of proficiency in PySpark or Scala, SQL, and Databricks notebook development.
• 3+ years of experience with healthcare data formats and terminology such as ICD, CPT, and LOINC.
• 2+ years of experience with cloud platforms including Azure, AWS, or GCP.
• 2+ years of familiarity with DevOps practices, CI/CD, and version control using Git or Azure DevOps.
• Deep understanding of ETL frameworks, data modeling, and performance optimization.

Preferred Skills

• Epic certification in Clarity, Caboodle, or Bridges.
• Experience with Delta Lake, Unity Catalog, or Databricks SQL.
• Knowledge of Structured Streaming, Databricks Lakehouse architecture, or dbt.

Key Skills

Education

Any Gradute