Description

Build and sustain large-scale big data solutions in a healthcare context, deploying batch and real-time pipelines across AWS and Google Cloud platforms.

This role is remote.

Responsibilities

• Build and deploy large-scale batch and real-time data pipelines into production.
• Maintain and sustain big data solutions and infrastructure.
• Manage data orchestration using Airflow.
• Operate across AWS and Google Big Data platforms.

Required Skills

• 7+ years of experience building and sustaining big data solutions.
• Extremely strong proficiency in Python.
• Experience building production-grade pipelines using Airflow.
• Deep experience with AWS services including S3.
• Experience with Google Cloud services including BigQuery and Google Buckets.
• Hands-on experience with Snowflake.
• Knowledge of data formats such as Parquet, Avro, or ORC.
• Experience with Elasticsearch (ES) and Redis.

Preferred Skills

• Proficiency in an additional programming or scripting language such as Java, Julia, Ruby, or Go.

Key Skills

Education

Any Gradute