AnythingLLM
AnythingLLM is an open-source local knowledge base tool that converts personal documents into intelligent knowledge bases. It integrates with local large language models such as Ollama to enable Retrieval-Augmented Generation (RAG), allowing users to query their own document collections through a conversational interface without relying on cloud-based services.
Core Facts
AnythingLLM is built on JavaScript, with React for the frontend and Node.js for the backend.
AnythingLLM is compatible with multiple LLM backends including OpenAI, Anthropic Claude, and local Ollama models.
AnythingLLM supports three platforms: Windows, macOS, and Linux.
Timeline (last 90 days)
Setting max token in AnythingLLM means setting the number of context windows; the larger the setting, the more accurate the results, but the longer the parsing time.
In his verification, Mike first asked "What are Gupao's employee reward and punishment policies", and the general-purpose model indicated there was no related content; after uploading the internal policy documents to the AnythingLLM workspace, the system automatically completed text splitting and vectorization and stored them in LanceDB, and when the question was asked again, the model retrieved the knowledge base and answered by citing document clauses.
In a local deployment of Ollama + AnythingLLM, Ollama provides model inference capability, and AnythingLLM handles RAG process orchestration.
When the author clicked next after configuring the address on a certain server, the Docker container crashed; after reviewing issues, it was determined to most likely be related to the CPU chip's instruction set support, and deployment succeeded after switching servers.
Pulling the official AnythingLLM image requires external network access and will result in an error; the solution is to configure domestic mirror sources such as Alibaba Cloud and USTC in /etc/docker/daemon.json.
Ollama listens on 127.0.0.1 (loopback address) by default, preventing AnythingLLM running inside a Docker container from accessing it.
The official AnythingLLM installer.sh script has issues running on Ubuntu, making installation via Docker a more reliable approach.
LlamaIndex, LangChain, and AnythingLLM are representative open-source frameworks for local knowledge base RAG solutions.
In AnythingLLM's API calls, the most important interface is the chat interface under Workspace-Thread, which requires two mandatory parameters: workspace slug and thread slug.
All Facts (20)
AnythingLLM is built on JavaScript, with React for the frontend and Node.js for the backend.
80%VerifiedAnythingLLM is compatible with multiple LLM backends including OpenAI, Anthropic Claude, and local Ollama models.
80%VerifiedAnythingLLM supports three platforms: Windows, macOS, and Linux.
80%VerifiedAnythingLLM is an open-source AI productivity tool developed by Mintplex Labs.
80%VerifiedOllama listens on local port 11434 by default, and AnythingLLM communicates with it via HTTP API.
75%VerifiedFor the 4-bit quantized version of a 7B parameter model, at least 8GB of memory and a modern multi-core CPU are typically required for smooth operation, with inference speeds of approximately 10–30 tokens per second
75%VerifiedAnythingLLM supports multi-user permission management and can assign different access rights by role.
75%VerifiedAnythingLLM is an open-source tool that can transform personal documents into an intelligent knowledge base, supporting integration with local large models such as Ollama to implement RAG functionality.
65%UnverifiedAnythingLLM中将聊天模式切换为查询（Query）模式后，模型才会严格只基于检索到的文档片段回答
90%UnverifiedAnythingLLM采用设备端优先架构，文档解析、向量化存储、AI推理全部在本地完成
90%UnverifiedAnythingLLM支持多模型（OpenAI、Anthropic、Ollama等）、RAG文档处理、多用户协作和Agent插件架构
90%UnverifiedAnythingLLM内置LanceDB作为默认向量存储方案
90%UnverifiedAnythingLLM通过集成Ollama、LM Studio等本地推理后端实现离线AI能力
90%UnverifiedAnythingLLM支持完全离线运行大语言模型，数据不需要经过任何第三方服务器
90%UnverifiedAnythingLLM的核心开发者是Timothy Carambat，此前在企业级SaaS领域有丰富经验
90%UnverifiedAnythingLLM内置了轻量级向量数据库，无需额外部署Milvus或Pinecone
90%UnverifiedAnythingLLM支持100%本地运行，数据无需上传到第三方服务器
90%UnverifiedAnythingLLM使用JavaScript作为主要开发语言，后端使用Node.js运行时
90%UnverifiedAnythingLLM前端基于React构建，后端运行在Node.js/Express之上，桌面应用通过Electron框架打包
90%UnverifiedAnythingLLM支持Docker一键部署
90%