Description

You will build and maintain data pipelines for complex data ingestion and processing tasks.

This role is remote.

Responsibilities

• Build and maintain Kafka pipelines for claims data ingestion and routing.
• Develop ETL/ELT processes integrating Amisys, Facets, ABS, and Excelys into Pisces.
• Implement schema validation and ensure data quality across multiple sources.
• Collaborate with BSAs and QA to deliver accurate edits and exclusions.
• Debug data pipeline issues in large-scale environments.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in Kafka, Python, and SQL for ETL and data validation.
• Experience with cloud-native data platforms: AWS Glue, Azure Data Factory, or GCP Dataflow.
• Familiarity with MongoDB or integration tools like Talend.
• Strong knowledge of data modeling and schema design principles.
• Ability to handle complex data ingestion tasks.

Key Skills

Education

Any Graduate