Unverified50% confidenceBenchmarkExact time
Nimble 9B completes a decision in an average of 90 milliseconds on the M5 Max, with only 1 to 4 output tokens and between 155 and 841 input tokens.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/7/2026
First Seen
Valid until: 1/5/2027
Sources
Related Entities
Related Claims
UnverifiedIn benchmark testing on an AMD RX 7900 GPU, Ornith 35B achieved an overall accuracy of 85% (18 out of 21 passed), a generation speed of 74 tokens/s, a prompt processing speed of 850 tokens/s, and a VRAM usage of 20 GB.69% similarUnverifiedThe UP host tested MiniCPM-2B on a computer with 4G VRAM and achieved a generation speed of 57 tokens per second, with a first-token latency of only 0.22 seconds.69% similarUnverifiedOn high-performance laptops, quantized Gemma models can achieve token generation speeds of 20–50 tokens per second; pure CPU inference is approximately 5–15 tokens/second, and INT4 quantization on NVIDIA RTX 4060/4070 can boost inference speed by 3–5 times.68% similarUnverifiedThe M5 Max's token generation speed is approximately in the range of 10–30 tokens/s (depending on model size), while the NVIDIA H100's HBM3 memory bandwidth reaches up to 3.35 TB/s, enabling inference speeds tens of times faster than local devices.68% similarUnverifiedLing 3.0 Tiny achieves an inference speed of approximately 86–90 tokens per second on a MacBook with M4 Pro, with a peak memory usage of approximately 8.34 GiB under an 8K context.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/984288API
curl https://kongchang.com/api/v1/knowledge/claims/984288MCP
get_claim(id=984288)