Description

You will design and deploy data pipelines that leverage agentic AI to solve real-world problems.

This role is on-site.

Responsibilities

• Design and develop data pipelines and robust data flows to handle complex interactions between AI agents and data sources.
• Build data architecture, including databases and data lakes, to support agentic systems and various engineering tasks.
• Manage ELT processes to move data accurately from source systems to analytical platforms.
• Implement pipelines that facilitate feedback loops for human-in-the-loop systems.
• Collaborate with data scientists to preprocess data, train models, and integrate AI into applications.

Required Skills

• 3+ years of experience developing Python scripts.
• 3+ years of experience training LLMs with structured and unstructured datasets.
• 2+ years of experience working with GIS spatial data for geolocating and topological correlation.
• Experience with Spark, Databricks, and GraphDB.
• Experience with Azure Data Lakes, Azure Databricks, and Azure Blob Storage.
• Proficiency in vector databases, embedding models, and AI agent frameworks.
• Knowledge of Azure AI services including Azure OpenAI, Azure AI Search, Azure Machine Learning, and Azure Computer Vision.
• Ability to implement data partitioning schemes and manage data conflation.
• Understanding of core machine learning concepts, algorithms, and statistical analysis.

Preferred Skills

• Experience with Department of Transportation data domains.
• Experience developing AI Composite Agentic Solutions for forecasting and what-if analysis.

Key Skills

Education

Any Graduate