Unverified60% confidenceFactTime unknown
An agent task requiring 20 LLM calls with 200 tokens generated each time takes approximately 133 seconds to complete at 30 TPS, but only 13 seconds at 300 TPS.
2
Sources
60%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedUnder a 4M TPM premise, long Agent turns with a 400K context can trigger at most 10 requests per minute (hitting the TPM cap), and full-context requests only 4 per minute.80% similarVerifiedThe request-response cycle handled by a traditional API gateway usually completes within 50 to 200 milliseconds, whereas an LLM API often needs to keep the connection open for 30 to 120 seconds.76% similarVerifiedOn a T4 GPU, Laya takes 33 milliseconds per single question, and batch processing can compress that to 7 milliseconds76% similarUnverifiedAt approximately 4K input, TTFT is 23.6 seconds with decoding at 46.6 tok/s; at 8K, 47 seconds and 41.4 tok/s; at 16K, 1 minute 30 seconds and 30.8 tok/s; at 30K, 3 minutes 15 seconds and 31.9 tok/s.75% similarUnverified遥操作采集一条完整示教通常需要30-120秒，加上重置环境时间，单人每小时有效采集量约为20-40条轨迹75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/18525API
curl https://kongchang.com/api/v1/knowledge/claims/18525MCP
get_claim(id=18525)