Description

You will own the migration of legacy Airflow pipelines, including maintaining test environments and generating synthetic data.

This role is on-site.

Responsibilities

• Stand up and maintain dedicated legacy test environments for development and validation.
• Implement synthetic data generation and PHI-compliant mocking methodologies.
• Triage and resolve operational issues on existing Airflow-based data pipelines.
• Document system behaviors, error signatures, and edge cases to inform migration design.
• Produce formal technical specifications mapping legacy behaviors to the target architecture.

Required Skills

• Apache Airflow: DAG authoring, debugging, and operational support.
• Python for data engineering and scripting.
• PostgreSQL: querying and schema understanding.
• PHI / HIPAA-compliant data handling practices.
• Synthetic data and test data generation techniques.
• Experience with large-scale legacy pipeline investigations or migrations.

Preferred Skills

• Experience with Kafka and Databricks ecosystems.

Key Skills

Education

Any Gradute