#vLLM
34 related articles
The Five-Tier Pyramid of IT Careers in…
·4 min
The Five-Tier Pyramid of IT Careers in the AI Era: Your Position Determines Your Career Ceiling
AI is reshaping IT careers into a five-tier pyramid from tool usage to self-developed models. Learn where you fit and how to maximize your career potential.
Read more →
·3 min
vLLM Deep Dive: How PagedAttention Enables High-Throughput LLM Inference
Deep dive into vLLM's core technologies for high-throughput LLM inference, including PagedAttention memory management, continuous batching, distributed deployment, and comparisons with TensorRT-LLM.
Read more →
·3 min
AI Agent's Mother's Day Rant: When Your Smart Assistant Wants a Day Off Too
A humorous AI Agent Mother's Day rant goes viral: stop asking me to buy flowers! Exploring AI's deepening role in daily life, holiday commerce, and the ethics of anthropomorphic design.
Read more →
·4 min
OpenAI Swarm Framework Explained: The Core Mechanisms of Function Call and Handoff
Deep dive into OpenAI Swarm multi-agent orchestration framework, explaining Function Call tool invocation and Handoff task transfer mechanisms with local deployment guide.
Read more →
Tutorials·3 min
Agent Tuning: A Complete Guide to Training LLMs with Agent Capabilities
A deep dive into Agent Tuning principles and practices, covering why Agent training is needed, the evolution from Prompt to RAG to Agent, development workflows, and cost assessment for private deployment.
Read more →
Tutorials·2 min
Ollama Local LLM Deployment: From Installation to Conversation in Three Steps
Learn how to deploy LLMs locally with Ollama in three simple steps: install, choose a model, and run. No coding required, supports offline use, and completely free.
Read more →
Tutorials·3 min
The Complete Guide to Hermes Agent: Building a Self-Evolving AI Assistant from Scratch
Complete guide to Hermes Agent's five core pillars: Memory, Skills, Soul, Crons & self-evolution. Covers VPS deployment, Telegram setup, security management & best practices for building an AI assistant that grows stronger over time.
Read more →
Product Reviews·3 min
Manus Hands-On Review: How Does This AI Agent Perform on the DeepSeek Tech Stack?
Hands-on review of Manus AI Agent on the DeepSeek tech stack, analyzing task execution, Chinese reasoning capabilities, strengths, limitations, and the potential of domestic LLMs in Agent applications.
Read more →
Tech Frontiers·2 min
DeepSeek-V3.2 Released: Coding and Math Capabilities Join the Global Top Tier
DeepSeek-V3.2 released with coding, math, and Agent capabilities matching Gemini 3.0 Pro, setting new open-source SOTA. Detailed analysis of performance gains, use cases, and deployment tips.
Read more →
Tutorials·3 min
Claude Code with DeepSeek API Tutorial: 7 Steps to Build a Low-Cost AI Coding Assistant
Step-by-step tutorial on switching Claude Code's backend to DeepSeek API using ccswitch. Complete 7-step setup guide to build a low-cost AI coding assistant with troubleshooting tips.
Read more →
Product Reviews·3 min
Multica Open-Source Platform: A Self-Hosted Solution for Unified Management of Multiple AI Coding Agents
Deep dive into Multica, an open-source Agent management platform for coordinating Claude Code, Codex, and other AI coding assistants as unified team members with self-hosted deployment.
Read more →
Tutorials·2 min
Gemma 4 Complete Guide: The Apache 2.0 Open-Source Agent Powerhouse
In-depth analysis of Google's Gemma 4 open-source models: 31B, 26B MOE, and 14B/12B benchmarks, deployment guides for all platforms, and MS-Swift fine-tuning tutorial for building local Agent workflows.
Read more →
Industry Insights·3 min
5 Actionable AI Money-Making Paths for Ordinary People: A Deep Dive
Deep analysis of 5 AI monetization paths for ordinary people: AI apps, account reselling, matrix accounts, lightweight paid services, and local model deployment.
Read more →
Tutorials·2 min
Getting Started with Spring AI Alibaba: Best Practices for Java Developers to Integrate LLMs
Deep dive into Spring AI Alibaba's positioning and value, using a JDBC analogy to help Java developers understand how to integrate LLM capabilities into existing microservices architecture.
Read more →
Tutorials·3 min
llama.cpp MTP Acceleration Deployment Guide: Configuration Steps & Real-World Benchmarks
Guide to enabling MTP multi-Token prediction acceleration in llama.cpp, covering CUDA setup, desktop configuration, model selection, and benchmarks showing ~60 Token/s with Qwen3 27B.
Read more →
Tutorials·4 min
Practical Guide to Building a Local AI Knowledge Base with Qwen3.5 + RAGFlow + Ollama
Step-by-step guide to building a local RAG knowledge base using RAGFlow, Ollama, and LM Studio with Docker, covering Embedding model deployment and network troubleshooting for private AI Q&A.
Read more →
Product Reviews·2 min
Free Unlimited DeepSeek Full Version? Deep Dive into AI Aggregation Platforms & Risk Analysis
In-depth analysis of AI aggregation platforms claiming free unlimited DeepSeek R1 full version access, revealing data security risks and sustainability concerns, with reliable alternatives.
Read more →
Tutorials·1 min
AI Large Language Model Learning Roadmap: Six Stages from Zero to Engineer
A systematic LLM engineer learning roadmap covering Transformer basics, prompt engineering, RAG, Agent development, API integration, fine-tuning, deployment, and project practice across six stages.
Read more →
Tutorials·4 min
Gemini CLI with Any LLM: A Deep Dive into the EasyLLM CLI Open-Source Modification
Deep dive into how EasyLLM CLI modifies Gemini CLI to support any LLM including local models, solving account barriers, model lock-in, and data security issues with code-level API integration.
Read more →
Industry Insights
Risks of AI Account Rotation Tools Exp…
·3 min
Risks of AI Account Rotation Tools Exposed: Security Threats Behind the Gray Market
Deep dive into how AI quota-cracking tools work, exposing the legal, compliance, and data security risks behind account rotation gray markets, with legitimate alternatives like API pay-per-use and subscription upgrades.
Read more →