Unverified50% confidenceBenchmarkExact time
The UP host tested MiniCPM-2B on a computer with 4G VRAM and achieved a generation speed of 57 tokens per second, with a first-token latency of only 0.22 seconds.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/19/2026
First Seen
Valid until: 12/18/2026
Sources
Related Entities
Related Claims
UnverifiedOn GSM8K, OQ4E took 2,450.2 seconds, while 8-bit took as long as 5,471.2 seconds, more than twice the time.77% similarUnverifiedWhen running at 1-bit precision on an M2 Max equipped with 96GB of VRAM, generation speed for simple tasks is consistently around 28–30 tokens/second75% similarUnverifiedOn high-performance laptops, quantized Gemma models can achieve token generation speeds of 20–50 tokens per second; pure CPU inference is approximately 5–15 tokens/second, and INT4 quantization on NVIDIA RTX 4060/4070 can boost inference speed by 3–5 times.75% similarUnverifiedAfter switching from Ollama to LM Studio and retuning parameters on an AMD 7900XT GPU, the token generation speed increased from 5 to 36 tokens per second.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/935200API
curl https://kongchang.com/api/v1/knowledge/claims/935200MCP
get_claim(id=935200)