Unverified50% confidenceFactExact time
Large model APIs are typically billed by token count, and generation speed is measured in tokens per second.
1
Sources
50%
Confidence
Long-term
Relevance
9/8/2026
First Seen
Sources
Related Entities
Related Claims
Unverified大模型调用的计费单位是Token而非请求次数，响应时间从毫秒级变为秒级甚至分钟级77% similarUnverifiedAirLLM 以推理速度为代价，每生成一个 token 耗时数秒乃至数十秒，远慢于高端 GPU 全量加载的每秒数十 token68% similarUnverifiedIn large model API call scenarios, cache hit rate refers to the reuse ratio of the KV Cache (key-value cache), where the model can directly read the attention key-value pairs of already-processed tokens from the cache.67% similarUnverifiedA 70B-parameter model (140 GB of weights) has a theoretical maximum generation speed of approximately 7 tokens/second at 1 TB/s bandwidth.66% similarUnverifiedIn the STM32 embedded development test, the locally deployed DS4 model had an average output speed of approximately 23 tokens/second, memory usage spiked to 110 GB during inference, and the peak speed reached 83.8 tokens/second.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/874718API
curl https://kongchang.com/api/v1/knowledge/claims/874718MCP
get_claim(id=874718)