#llama.cpp
20 related articles
KeyType: A Free, Open-Source System-Le…
·2 分钟
KeyType: A Free, Open-Source System-Level AI Autocomplete Tool for macOS
KeyType is a free, MIT-licensed macOS tool for system-level AI text completion. It runs local LLMs, supports custom models, and keeps all data on your device.
阅读全文 →
·3 分钟
vLLM Deep Dive: How PagedAttention Enables High-Throughput LLM Inference
Deep dive into vLLM's core technologies for high-throughput LLM inference, including PagedAttention memory management, continuous batching, distributed deployment, and comparisons with TensorRT-LLM.
阅读全文 →
·4 分钟
OpenAI Swarm Framework Explained: The Core Mechanisms of Function Call and Handoff
Deep dive into OpenAI Swarm multi-agent orchestration framework, explaining Function Call tool invocation and Handoff task transfer mechanisms with local deployment guide.
阅读全文 →
深度解读·3 分钟
Complete Guide to LLM Training: Pre-training, SFT Fine-tuning, and Preference Alignment Explained
Complete guide to the three core LLM training stages: pre-training, supervised fine-tuning (SFT), and preference alignment (DPO/PPO), covering LoRA, distillation, quantization, and pruning.
阅读全文 →
教程攻略·2 分钟
Ollama Local LLM Deployment: From Installation to Conversation in Three Steps
Learn how to deploy LLMs locally with Ollama in three simple steps: install, choose a model, and run. No coding required, supports offline use, and completely free.
阅读全文 →
产品体验·3 分钟
Google Gemma 4 Hands-On Review: Offline on Smartphones + Ollama Deployment Tutorial
Hands-on testing of Google Gemma 4 open-source models running offline on three phones, with Dense vs MOE architecture explained and a complete Ollama + Claude Code deployment tutorial.
阅读全文 →
产品体验·3 分钟
WhichLLM: One Command to Find the Best Local LLM for Your Hardware
WhichLLM is an open-source tool that auto-detects your hardware and recommends the best local LLM using real benchmark data. Simulate GPUs, filter fake benchmarks, and start chatting in one command.
阅读全文 →
产品体验·3 分钟
Claude Code Firmware-Level Ops in Practice: Virtual Disk Expansion & Local Agent Deployment
Hands-on testing of Claude Code for firmware-level ops: Ventoy virtual disk expansion, ext4-to-btrfs conversion, and a cost-effective local Agent deployment architecture with distributed design.
阅读全文 →
教程攻略·3 分钟
llama.cpp MTP Acceleration Deployment Guide: Configuration Steps & Real-World Benchmarks
Guide to enabling MTP multi-Token prediction acceleration in llama.cpp, covering CUDA setup, desktop configuration, model selection, and benchmarks showing ~60 Token/s with Qwen3 27B.
阅读全文 →
教程攻略·3 分钟
Frontend AI Full-Stack Development in Practice: Building Multimodal Applications with PNPM MonoRepo Architecture
A practical guide to frontend AI full-stack development covering PNPM MonoRepo architecture, TurboRepo build optimization, and LangChain multimodal applications with Ollama local model deployment.
阅读全文 →
教程攻略·2 分钟
Tutorial: Building a Low-Cost AI Code Editor with DeepSeek-V3 + VSCode
Step-by-step tutorial: Build a low-cost AI programming assistant using DeepSeek-V3 API with VSCode's Continue plugin. Covers setup, API Key configuration, code completion demo, and Ollama local deployment.
阅读全文 →
教程攻略·3 分钟
AnythingLLM Installation & Configuration Guide: Building a Local Knowledge Base with API Integration
Complete guide to AnythingLLM local knowledge base setup: installation tips, Ollama model configuration, document vectorization, recall optimization, and API integration.
阅读全文 →
产品体验·2 分钟
Free Unlimited DeepSeek Full Version? Deep Dive into AI Aggregation Platforms & Risk Analysis
In-depth analysis of AI aggregation platforms claiming free unlimited DeepSeek R1 full version access, revealing data security risks and sustainability concerns, with reliable alternatives.
阅读全文 →
产品体验·3 分钟
Hertzman: A Free, No-Install Local LLM Deployment Tool Review
Detailed review of Hertzman local inference engine covering one-click deployment, smart hardware recommendations, OpenAI-compatible API, and performance comparison with LM Studio.
阅读全文 →
教程攻略·2 分钟
Complete Guide to Configuring Local DeepSeek Model in PyCharm for AI-Assisted Programming
Learn how to configure a local DeepSeek model in PyCharm via Ollama for free, privacy-safe AI-assisted programming. Includes installation steps, plugin setup, usage tips, and hardware recommendations.
阅读全文 →
教程攻略·3 分钟
oMLX + MTP + Qwen3.6: Local AI Coding Speed Breaks New Records
Using oMLX with MTP and Qwen3.6 35B on Apple Silicon Mac to achieve 86.7 tokens/s local coding speed, building a full-stack app in under 5 minutes.
阅读全文 →
行业洞察
Risks of AI Account Rotation Tools Exp…
·3 分钟
Risks of AI Account Rotation Tools Exposed: Security Threats Behind the Gray Market
Deep dive into how AI quota-cracking tools work, exposing the legal, compliance, and data security risks behind account rotation gray markets, with legitimate alternatives like API pay-per-use and subscription upgrades.
阅读全文 →
教程攻略
pnpm Monorepo Full-Stack AI Engineerin…
·2 分钟
pnpm Monorepo Full-Stack AI Engineering in Practice: Building a Multimodal Conversation System
Learn how to build a full-stack multimodal AI conversation system using pnpm Monorepo architecture, covering local model integration, image understanding, and streaming chat.
阅读全文 →
产品体验
Running Qwen3.6-27B Locally on Mac: 4 …
·3 分钟
Running Qwen3.6-27B Locally on Mac: 4 Solutions Benchmarked
Benchmarking 4 solutions for running Qwen3.6-27B locally on Mac: GGUF, MLX Diflash, and MTP-LX. MTP-LX 4bit leads at 43.6 tok/s with solid coding, writing, and reasoning quality.
阅读全文 →
教程攻略
Complete Guide to Local LLM Deployment…
·2 分钟
Complete Guide to Local LLM Deployment with Ollama: AI That Works Offline
Complete guide to deploying open-source LLMs locally with Ollama. Covers installation, model selection, VRAM requirements, and performance comparison of Llama 3 and Qwen models. Free, offline-capable AI.
阅读全文 →