Description

Build and own data pipelines within the Azure ecosystem, focusing on cloud ingestion and XML data processing.

This role is remote.

Responsibilities

• Develop Python code for XML shredding and parsing to produce cleansed data outputs.
• Create low-level design documents, requirement specifications, and traceability matrices.
• Execute unit testing, prepare test cases, and document all results.
• Manage tasks within JIRA, providing daily updates and flagging technical impediments.
• Analyze functional and non-functional requirements to identify technical gaps and feasibility.

Required Skills

• 10+ years of professional experience in data engineering.
• Strong proficiency with Azure Databricks and Azure cloud environments.
• Expertise in Python for data engineering tasks.
• Hands-on experience with XML parsing and shredding.
• Proficiency in JIRA for task management and tracking.

Preferred Skills

• Support UAT and QA processes to ensure data quality and adherence to enterprise metadata standards.

Key Skills

Education

Not specified