Description

Lead the design and maintenance of scalable data pipelines in the healthcare domain.

This role is on-site.

Responsibilities

• Design, develop, and maintain scalable data pipelines using established software development patterns.
• Implement data processing solutions using Python and PySpark on a cloud-native Lakehouse platform.
• Write efficient SQL queries to execute extraction, transformation, and loading processes.
• Optimize and troubleshoot pipelines to ensure performance, reliability, and data integrity.
• Apply DevOps principles and CI/CD workflows to deploy and operate data pipelines.

Required Skills

• 12+ years of professional experience in data engineering.
• Recent experience working within the healthcare domain.
• Proficiency in Python and PySpark.
• Strong expertise in SQL and database management.
• Hands-on experience with AWS.
• Experience with ETL/ELT processes and data pipeline orchestration.
• Knowledge of software development patterns and data engineering best practices.
• Experience with version control and automated testing using GitHub and GitHub Actions.

Preferred Skills

• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science