Description

ABOUT THE ROLE 
We are looking for a Senior Data Engineer with strong PostgreSQL, Kafka, and business logic implementation 
experience to own the post-ingestion layer of a healthcare data pipeline. You will translate upstream events 
into downstream data models, implement complex processing logic, and ensure a zero-loss cutover from the legacy system. 

KEY RESPONSIBILITIES 
• Translate Kafka-based ingestion events into downstream PostgreSQL data models (patient stays and 
updates) 
• Implement complex business logic including episode identification, stay deduplication, and state machine 
execution 
• Build event publishing mechanisms to trigger downstream notifications (alerts, worklist changes) reliably 
• Design and execute a dual-write verification system to compare rewrite output against the legacy system 
• Migrate live production traffic incrementally to the new pipeline with zero data loss 
• Support integration testing and troubleshooting with internal engineering teams during transition 

REQUIRED SKILLS & EXPERIENCE 
• PostgreSQL — complex schema design, upserts, indexing, query optimization 
• Apache Kafka — consumer-side patterns, event-driven integration 
• Python — state machine logic, business rule implementation 
• Dual-write and incremental traffic cutover patterns 
• Integration testing, mocking, and validation strategies 
• Experience with event-driven notification or alerting systems 

NICE TO HAVE 
• Databricks (for upstream pipeline context) 
• Redis or stateful caching layers 
• Datadog, Grafana, or OpenTelemetry for observability 
• Healthcare clinical workflow familiarity

Key Skills

Education

Any Graduate