Description

You will build and maintain core infrastructure for data retrieval and AI services.

This role is remote.

Responsibilities

• Develop a foundational indexing framework to onboard Strategic Data Assets.
• Integrate and manage diverse data types including text, images, and videos for retrieval and generation.
• Ensure scalability, reliability, and performance of production data retrieval systems.
• Implement automation strategies to streamline data onboarding and processing workflows.
• Monitor and analyze data pipeline performance to optimize efficiency.

Required Skills

• 8+ years of software engineering experience, primarily in ETL pipeline development.
• Proficiency in Python and FastAPI.
• Proven experience building and deploying Retrieval Augmented Generation (RAG) pipelines.
• Familiarity with processing multimodal data for retrieval and generation tasks.
• Strong understanding of SQL and NoSQL database systems and data warehousing.
• Experience with Azure Services, including Azure AI Search and Azure AI Foundry.
• Experience with Azure Kubernetes and relevant Azure services.

Preferred Skills

• Experience with Databricks and Helm charts for Kubernetes management.

Key Skills

Education

Any Graduate