Unverified50% confidenceDecision RuleExact time
The probe workshop recommends sending the same fixed prompt 12 times serially and recording one line of JSON each time, because concurrency would destroy the signal by folding the latency distribution into a step function due to the rate limiter.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
Unverified张量并行的通信瓶颈不是单次传输的数据量,而是同步次数乘以每次同步的固有延迟。66% similarUnverified约束解码通过语法掩码保证输出符合JSON等文法,但会破坏MTP、投机解码等并行验证加速路径,导致速度下降,需在可解析性与吞吐速度之间权衡。65% similarUnverifiedCoordinated omission refers to how, in a closed-loop load generator, the generator slows its send pace in step when the system under test slows down, causing queueing latency to be systematically underestimated; open-loop scheduling that sends requests on a fixed timetable avoids this problem.64% similarUnverifiedRetry rates usually stem from three types of events: vendor-side rate limiting (429 errors), network timeouts, and model outputs failing structured validation (such as JSON parsing failures or invalid tool-call parameters).64% similarUnverifiedTwelve serial calls measure only one machine, one path, one moment; vendor behavior changes and free-tier conditions change, and one good afternoon proves nothing about next month.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1067304API
curl https://kongchang.com/api/v1/knowledge/claims/1067304MCP
get_claim(id=1067304)