Description

You will design and maintain scalable data architectures and pipelines for big data processing, leading projects and enforcing engineering best practices.

This role is remote.

Responsibilities

• Design and maintain scalable data architectures and pipelines for big data processing.
• Lead data projects and enforce engineering best practices across the team.
• Optimize data systems to support analytics and reporting workflows.
• Ensure data quality and system reliability within production environments.

Required Skills

• 8+ years of IT experience.
• 5+ years of experience with Python, PySpark, and SQL.
• Experience with data lakes using Iceberg format.
• Proficiency in ETL processes using Informatica.
• Hands-on experience with AWS services: S3, Glue, Redshift, Lambda, EMR, and Airflow.
• Experience with Postgres and BASH/Shell scripting.
• Background working with healthcare data.
• Experience leading data teams.
• Practical experience with Agile development methodologies.

Key Skills

Education

Not specified