Description

You will design and build the core data platform infrastructure for cross-agent querying and analytics.

This role is on-site.

Responsibilities

• Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse, warehouse, SQL) and Azure Data Factory.
• Build and maintain a metadata-driven Lakehouse architecture supporting multiple consumption patterns.
• Develop agent-specific data lakes and orchestration layers for cross-agent querying.
• Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics tools.
• Ensure data quality, lineage, and governance across all ingestion and transformation processes.

Required Skills

• 7+ years of experience in data engineering focused on the Microsoft Azure Data stack and Fabric technologies.
• Strong expertise in Microsoft Fabric components: Lakehouse, Dataflows Gen2, Pipelines, and Notebooks.
• Proficiency with Azure Data Factory, Azure SQL, and Azure Data Lake Storage Gen2.
• Strong command of SQL, Python, and PySpark/Scala.
• Experience handling structured and semi-structured data (JSON, XML, CSV, Parquet).
• Proven ability to build metadata-driven architectures and reusable components.
• Strong understanding of data modeling, data governance, and security best practices.
• Experience with data visualization tools, specifically Power BI.

Preferred Skills

• Experience with Azure OpenAI integration for analytics.

Key Skills

Education

Any Graduate