You will design and build end-to-end data solutions leveraging cloud-native architecture on Azure.
Responsibilities
- Architect Microsoft Fabric solutions, including Data Factory, OneLake, Lakehouse, and real-time analytics platforms.
- Design and deploy AI models utilizing Azure AI Foundry and Azure OpenAI Service.
- Implement data pipelines to ingest and process data from sources like SQL, APIs, Salesforce, and Oracle.
- Optimize semantic models and implement medallion architecture across data layers.
- Monitor data pipeline performance using Fabric Capacity Metrics and resolve ingestion issues.
Required Skills
- 8+ years of experience in data engineering with Azure.
- Expertise with Microsoft Fabric components: Data Factory, OneLake, Lakehouse, Power BI, and KQL.
- Strong proficiency in SQL, Python, and Spark/Python development.
- Experience integrating LLMs using Azure OpenAI and Copilot capabilities.
- Familiarity with containerization technologies like Docker and Azure Container Apps.
- Experience building and troubleshooting data pipelines from diverse sources.
- Knowledge of data modeling techniques, specifically medallion architecture.