#LiteLLM
5 related articles
LiteLLM 1.107.0 Caught in Supply Chain Attack: Credential Stealer and Backdoor Planted in PyPI Package
LiteLLM 1.107.0 on PyPI was tampered with, planting a credential stealer and backdoor. This analysis covers the attack path, real risks to AI projects, and supply chain defenses like dependency verification, key isolation, and outbound traffic monitoring.
LiteLLM in Practice: One Proxy to Rule All Your Local and Cloud LLMs
LiteLLM unifies local inference (Ollama, vLLM) and cloud APIs (OpenAI, Anthropic) into one OpenAI-compatible gateway, with waterfall routing, load balancing, and cost control for Homelab AI setups.
LiteLLM Smart Routing in Practice: Automatic Traffic Distribution Between Large and Small Local LLMs
LiteLLM as a unified gateway for local LLMs: automatic routing between large and small models. Covers heuristic vs. LLM classifiers, Ollama/MLX setup, and Pi Coding Agent integration.
TutorialsClaude Agent SDK + LiteLLM + Local LLMs: Building a Zero-Cost AI Agent Platform
Learn how to redirect Claude Agent SDK API requests to local LLMs via LiteLLM Proxy, achieving zero-cost inference while retaining full agent framework capabilities.
Product ReviewsLiteLLM: A Deep Dive into the Open-Source Gateway for 100+ LLM APIs
Deep dive into LiteLLM, the open-source AI gateway supporting 100+ LLM APIs with a unified OpenAI format. Covers core features, usage modes, and enterprise use cases.