Description

Build data pipelines within the Azure ecosystem to facilitate cloud ingestion. Own the development of Python code for XML shredding and parsing to produce cleansed data outputs.

Responsibilities

• Develop Python code to perform XML shredding and parsing for cleansed data output.
• Create low-level design documents, requirement specifications, and traceability matrices.
• Execute unit testing, prepare test cases, and document all results.
• Manage tasks within JIRA, providing daily updates and flagging technical impediments.
• Analyze functional and non-functional requirements to identify technical gaps and feasibility.

Required Skills

• 10+ years of professional experience in data engineering.
• Strong proficiency with Azure Databricks.
• Expertise in Python for data engineering tasks.
• Hands-on experience with XML parsing and shredding.
• Proven track record in Azure cloud environments.
• Proficiency in JIRA for task management and tracking.

Preferred Skills

• Support UAT and QA processes to ensure data quality and adherence to enterprise metadata standards.

Key Skills

Education

Not specified