Description

You will build and manage data pipelines and warehousing solutions within the Azure ecosystem.

Responsibilities

• Create, manage, and optimize ETL processes to ensure data quality and efficient flow.
• Build Python pipeline jobs and clusters using Azure Synapse.
• Monitor and troubleshoot data systems to ensure performance and reliability.
• Implement data security, metadata management, and compliance protocols.
• Use Azure AI Document Intelligence for document processing and data extraction.

Required Skills

• 3+ years of Python experience, specifically using libraries to extract data from PDF and MS Office files.
• Hands-on experience with Azure Synapse Analytics to create pipeline jobs and clusters.
• Proficiency in Azure Data Factory, Azure SQL Database, and Azure Storage.
• Experience with Azure AI Document Intelligence for data extraction.
• Strong knowledge of API integration.
• Deep understanding of data warehousing, ETL processes, and data modeling.
• Proven track record in data manipulation, scripting, and automation.
• 5-10 years of professional experience in data engineering roles.

Key Skills

Education

Not specified