Description

Job Description

Required Technical Skills

• Strong experience in Python and software development.
• Hands-on experience with LiteLLM, including:
  • LiteLLM Proxy / Gateway
  • Multi-model integration
  • Model routing and fallbacks
  • Load balancing
  • Authentication and access control
  • Rate limiting and usage monitoring
• Strong understanding of LLM APIs and Generative AI concepts.
• Experience with one or more LLM providers:
  • OpenAI / Azure OpenAI
  • Anthropic
  • Google Gemini
  • AWS Bedrock
  • Open-source LLMs such as Llama, Mistral, etc.
• Experience with RAG architecture and vector databases such as:
  • Pinecone
  • Weaviate
  • Milvus
  • Chroma
  • FAISS
  • Elasticsearch / OpenSearch
• Experience with frameworks such as LangChain, LlamaIndex, Semantic Kernel, or similar.
• Experience developing REST APIs using FastAPI, Flask, or similar frameworks.
• Good understanding of Docker and containerized deployments.
• Experience with cloud platforms such as Azure, AWS, or GCP.
• Familiarity with CI/CD, Git, Kubernetes, and production deployment practices

Key Skills

Education

Any Graduate