Description

You will build and scale data infrastructure on Azure, handling unstructured data and PII/PHI with a focus on production-ready systems.

Responsibilities

• Develop and maintain data pipelines using Python for manipulation and processing.
• Design and implement solutions using Azure AI Search, Document Intelligence, and function apps.
• Integrate and manage vector databases to support advanced data retrieval and analysis.
• Scale proof-of-concept implementations to robust production environments.
• Ensure compliance and security when working with sensitive PII/PHI data in Snowflake.

Required Skills

• 10+ years of experience as a Data Engineer.
• Hands-on expertise with the Azure Cloud ecosystem.
• Proficiency in Python for data engineering tasks.
• Deep understanding of vectors and vector databases.
• Experience working with Snowflake for data warehousing.
• Practical experience with Azure AI Search and Document Intelligence (Form Recognizer).
• Proven track record of scaling POCs to production.
• Ability to handle unstructured data and PII/PHI securely.

Key Skills

Education

Any Gradute