You will build and manage the data infrastructure required to power agentic AI systems and large language models.
Responsibilities
- Design and develop data pipelines and flows to handle complex interactions between AI agents and data sources.
- Build data architecture, including databases and data lakes, to support data engineering tasks.
- Develop and manage ELT processes to move data from source systems to analytical platforms.
- Train and fine-tune large language models.
- Implement GIS spatial data workflows for geo-location, topology, and mapping.
Required Skills
- 10+ years of experience in data engineering or related roles.
- Expertise in integrating with AI agent frameworks.
- Experience with Azure AI services, including Azure OpenAI models, Azure AI Search, Azure Computer Vision, and Azure Video Indexer.
- Proficiency with Azure Blob Storage, Azure Data Lakes, and Azure Databricks.
- Experience implementing Azure Machine Learning and Azure Media Services.
- Knowledge of ELT processes.
- Experience with Graph DB.
- Hands-on experience with GIS spatial data and geospatial correlations.
- Azure Certification.
Preferred Skills