You will build and operate advanced AI systems using large language models and Azure services.
Responsibilities
Design, implement, and operate Retrieval-Augmented Generation (RAG) services using Azure AI/Search, including chunking, embeddings, re-ranking, evaluation, and citation display.
Build agentic AI solutions using AutoGen, CrewAI, and/or Agno, enabling secure tool-calling and multi-agent orchestration.
Develop production-grade chatbots with prompt management, guardrails, audit logging, and telemetry.
Integrate Azure OpenAI securely behind API Management (APIM), managing secrets with Key Vault and handling events via Event Hub.
Ship features with CI/CD on Azure DevOps, implementing tests and red-teaming for prompt injection.
Required Skills
4-8 years total software development experience, with 2+ years in applied LLM/GenAI.
Strong Python skills and hands-on experience with Azure OpenAI and Azure AI/Search (vector search, hybrid search, semantic ranking).
Practical experience with agent frameworks (AutoGen, CrewAI, Agno) and MCP/tool-use patterns.
Proven Azure PaaS experience: Azure Functions or Web Apps, APIM, Key Vault, Event Hub; familiarity with Entra ID/RBAC.
Experience implementing observability (App Insights, Log Analytics/KQL) and CI/CD with Azure DevOps.
Experience evaluating and fine-tuning open-source models (e.g., PEFT/LoRA).