Description

You will build and manage the data infrastructure for autonomous agentic systems, including pipeline design and LLM training.

This role is remote.

Responsibilities

• Design and develop data pipelines specifically for agentic systems.
• Build data flows to manage complex interactions between AI agents and various data sources.
• Train LLMs using structured and unstructured datasets.
• Integrate GIS spatial data into existing workflows.

Required Skills

• 5+ years of experience in data pipeline design and development.
• Proficiency with Apache Spark.
• Experience with Azure Databricks.
• Experience training LLMs with structured and unstructured data.
• Experience working with GIS spatial data.
• Background in big data frameworks.
• Bachelor's degree or equivalent professional work experience.

Preferred Skills

• Experience with GraphDB.
• Knowledge of data partitioning and data conflation.

Key Skills

Education

Any Graduate