#LLM inference
41 related articles
KeyType: A Free, Open-Source System-Le…
·2 min
KeyType: A Free, Open-Source System-Level AI Autocomplete Tool for macOS
KeyType is a free, MIT-licensed macOS tool for system-level AI text completion. It runs local LLMs, supports custom models, and keeps all data on your device.
Read more →
·3 min
vLLM Deep Dive: How PagedAttention Enables High-Throughput LLM Inference
Deep dive into vLLM's core technologies for high-throughput LLM inference, including PagedAttention memory management, continuous batching, distributed deployment, and comparisons with TensorRT-LLM.
Read more →
·4 min
Google Hybrid Inference Comes to iOS: A Complete Guide to On-Device AI Cross-Platform Deployment
Google Hybrid Inference officially supports iOS, adds Gemma 4 on Android, and Chrome local Web inference nears GA. A deep dive into hybrid inference technology, cross-platform advantages, and developer opportunities.
Read more →
·4 min
Google Hybrid Inference Comes to iOS: A Complete Guide to On-Device AI Cross-Platform Deployment
Google Hybrid Inference now supports iOS, adds Gemma 4 on Android, and Chrome local Web inference nears GA. A deep dive into hybrid inference technology, cross-platform advantages, and developer opportunities.
Read more →
Tutorials·2 min
Building E-commerce Videos with Coze Workflows: A Hands-On Tutorial with Seedance and Happy Horse
Learn how to build automated e-commerce video workflows in Coze using Seedance 2.0 and Happy Horse plugins. Covers node setup, prompt generation, loop querying, and practical tips.
Read more →
Tutorials·2 min
Building E-commerce Videos with Coze Workflows: A Hands-On Tutorial with Seedance and Happy Horse
Learn how to build automated e-commerce video workflows using Coze with Seedance 2.0 and Happy Horse plugins. Covers node setup, prompt generation, and loop querying.
Read more →
Product Reviews·1 min
Lenovo ThinkBook 16+ R7-H255 Review: Is This $660 AI Programming Laptop Worth It?
Lenovo ThinkBook 16+ with AMD R7-H255 at $660: a 16-inch laptop for AI programming and business use. Full analysis of performance, value, and buying advice.
Read more →
Tech Frontiers·2 min
Google Gemini Antigravity Weekly Quota Tripled — AI Coding Without Limits
Google Gemini triples Antigravity weekly quotas following a prior daily quota boost. Analyzing the impact on developers and its strategic significance in AI coding.
Read more →
Product Reviews·3 min
Non-Programmer Ships a Product in 16 Days Using AI Tools: A Complete Toolchain Retrospective
A non-coder indie developer shipped a product in 16 days using Gemini, Cline, MiniMax, and DeepSeek. Full retrospective on tool selection, model quality gaps, and practical lessons learned.
Read more →
Product Reviews·2 min
DeepSeek V4Pro for Free? The Truth About AI Aggregation Platforms & How to Avoid Getting Scammed
A Bilibili video claims DeepSeek V4Pro is free and unlimited, but no such version officially exists. This article analyzes third-party AI aggregation platforms, their risks, and safer alternatives.
Read more →
Tutorials·1 min
How to Use Grok's Latest Model for Free Without Limits — And the Risks Involved
A detailed look at free unlimited Grok access methods, including AI image generation, along with risk assessment covering data privacy, account security, and official alternatives.
Read more →
Product Reviews·3 min
WhichLLM: One Command to Find the Best Local LLM for Your Hardware
WhichLLM is an open-source tool that auto-detects your hardware and recommends the best local LLM using real benchmark data. Simulate GPUs, filter fake benchmarks, and start chatting in one command.
Read more →
Tutorials·3 min
Complete Guide to Downloading, Installing, and Configuring Trae AI Coding Tool
Complete guide to ByteDance's free AI coding tool Trae: download, install, configure, and use with built-in Doubao, DeepSeek models. Native Chinese support, no VPN needed for developers in China.
Read more →
Tech Frontiers·1 min
Opus 4.7 Fast Mode Lands on Windsurf: 2.5x Speed Boost with No Loss in Intelligence
Claude Opus 4.7 fast mode launches on Windsurf with ~2.5x speed boost while maintaining full intelligence. Analysis of its impact on AI-assisted coding and Windsurf's competitive strategy.
Read more →
Tutorials·2 min
Getting Started with Spring AI Alibaba: Best Practices for Java Developers to Integrate LLMs
Deep dive into Spring AI Alibaba's positioning and value, using a JDBC analogy to help Java developers understand how to integrate LLM capabilities into existing microservices architecture.
Read more →
Tutorials·3 min
Hermes Orchestrating DeepSeek + MiniMax Dual-AI Collaborative Coding: A From-Scratch Project Test
Testing Hermes agent coordinating DeepSeek V4 and MiniMax 2.7 for collaborative coding: PDF export in 9 minutes, RSS service built from scratch in Nim language.
Read more →
Product Reviews·3 min
AnySearch: A Search Plugin Designed for AI Agents — Save Tokens, Boost Results
AnySearch is a search plugin for AI Agents that provides structured, high-quality data, filtering internet noise. Tests show 3x reduction in token consumption with significantly better answer quality.
Read more →
Industry Insights·2 min
Two Major Career Paths in AI Large Language Models: Engineering Implementation vs. Algorithm Research
In-depth analysis of two core AI LLM career paths: engineering implementation vs. algorithm research. Compare education requirements, skills, and job prospects for programmers transitioning to AI.
Read more →
Tutorials·3 min
oMLX + MTP + Qwen3.6: Local AI Coding Speed Breaks New Records
Using oMLX with MTP and Qwen3.6 35B on Apple Silicon Mac to achieve 86.7 tokens/s local coding speed, building a full-stack app in under 5 minutes.
Read more →
Tutorials
pnpm Monorepo Full-Stack AI Engineerin…
·2 min
pnpm Monorepo Full-Stack AI Engineering in Practice: Building a Multimodal Conversation System
Learn how to build a full-stack multimodal AI conversation system using pnpm Monorepo architecture, covering local model integration, image understanding, and streaming chat.
Read more →