Unverified50% confidenceBenchmarkExact time
GFX1151 Engine's decoding (conversational generation) speed on the AMD 395 is 30 to 40 tokens per second, depending on the acceptance rate of speculative sampling.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/5/2026
First Seen
Valid until: 1/3/2027
Sources
Related Entities
Related Claims
UnverifiedIn benchmark testing on an AMD RX 7900 GPU, Ornith 35B achieved an overall accuracy of 85% (18 out of 21 passed), a generation speed of 74 tokens/s, a prompt processing speed of 850 tokens/s, and a VRAM usage of 20 GB.75% similarUnverifiedThe RTX 4090 has a theoretical FP16 compute performance of 330 TFLOPS, and the actual Decode speed for a 7B FP16 model is typically 50–60 tokens/s.72% similarUnverifiedOn 6 RTX 5090 GPUs, Colibri's measured speed reaches 9.0–9.2 tokens/s, while on a 25GB development machine streaming from NVMe the speed is 0.05–0.1 tokens/s.70% similarVerifiedOn the RTX 5090, Muse Glimmer's generation speed increases from 75 tokens per second to 233 tokens per second, a speedup of approximately 3.1×.69% similarUnverifiedIn a dual-GPU setup with a 70-billion-parameter model, a user's real-world test showed llama.cpp reading prompt tokens at 1,490 tokens per second while KoboldCpp only achieved 34, the cause being a configuration error rather than an engine defect.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/978818API
curl https://kongchang.com/api/v1/knowledge/claims/978818MCP
get_claim(id=978818)