Verified65% confidenceFactTime unknown
LiteLLM provides two usage modes: a Python SDK and a Proxy Server (AI Gateway).
3
Sources
65%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedLiteLLM's Proxy mode runs as a standalone FastAPI service, supporting virtual key management, team-level budget limits, request retries and fallback chain configuration, and model groups, priorities, and rate-limiting rules definable via YAML configuration files.76% similarUnverifiedSAP AI Core LLM Proxy使用Python开发73% similarVerifiedLiteLLM, Portkey, and Kong AI Gateway are typical open-source or commercial implementations of AI gateways.71% similarUnverifiedPalimpsest Gateway is open-sourced under the MIT license, written in Python/FastAPI, and can be run via docker compose up.66% similarUnverifiedLiteLLM's local providers include ollama, llama_cpp, vllm, tgi, and others.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/28274API
curl https://kongchang.com/api/v1/knowledge/claims/28274MCP
get_claim(id=28274)