Description

You will build and manage data pipelines within a complex data environment.

Responsibilities

• Design and implement ETL/ELT pipelines processing raw XML and JSON from multiple parallel sources.
• Develop and manage database schemas, including writing DDL scripts and implementing complex transformation logic.
• Perform data validation, profiling, and scripting to ensure data quality across all integrated sources.
• Integrate healthcare data adhering to HL7 and FHIR standards, including QA on EMR systems.

Required Skills

• 8+ years of experience in Data Engineering with a focus on data analysis principles.
• Expertise in Azure Data Factory (ADF) and related Azure data services.
• 5+ years working with healthcare data, specifically HL7 and FHIR standards.
• Proficiency in SQL, including experience with data arrays and LATERAL joins.
• Strong scripting skills in Python, applied to data manipulation and validation.
• Experience designing pipelines using XML and JSON data formats.
• Proven background as a SQL Developer transitioning into Data Engineering.
• Familiarity with data quality monitoring and tracking processes.

Key Skills

Education

Any Graduate