Description

You will design and manage data pipelines within the healthcare domain.

This role is on-site.

Responsibilities

• Build and manage efficient ETL pipelines using Databricks workflows or other orchestration frameworks.
• Optimize the performance of data extract scripts and SQL/SparkSQL queries.
• Perform data analysis and mapping to meet specific client output requirements.
• Develop data distribution extracts and scripts.
• Collaborate with clients and implementation teams to understand data distribution needs.

Required Skills

• 10+ years of experience in data engineering.
• Mandatory experience in the Healthcare domain.
• Proficiency with Python, FHIR, Databricks, and SQL.
• Experience processing structured and semi-structured data using PySpark.
• Hands-on experience with AWS services, specifically S3 and SQS.
• Proficiency with Spark SQL and query tuning.
• Experience with Terraform and GitLab CI/CD.
• Familiarity with data warehousing using Snowflake or similar platforms.

Preferred Skills

• Background working for a cloud-based data services provider for large healthcare clients.
• Direct experience with FHIR data standards.

Key Skills

Education

Any Graduate