Description

You will build and manage data engineering solutions for healthcare data clients.

Responsibilities

• Build and manage efficient ETL pipelines using Databricks workflows or other orchestration frameworks.
• Ingest and process structured and semi-structured data using PySpark.
• Implement data distribution extracts and scripts, optimizing their performance.
• Perform data analysis and mapping required to produce client outputs.
• Query tune and optimize performance in SQL and/or SparkSQL.

Required Skills

• 14 years of professional experience.
• Proficiency in Python and SQL.
• Experience building ETL Pipelines.
• Hands-on experience with Databricks and PySpark.
• Familiarity with AWS services (S3, SQS) or comparable cloud services.
• Experience with Infrastructure as Code using Terraform.
• Proficiency with GitLab CI/CD for automation.
• Experience with Snowflake or similar data warehousing solutions.
• Familiarity with FHIR standards.

Key Skills

Education

Any Graduate