Unverified50% confidenceFactExact time
一次AI API调用的延迟包括网络往返时间(50-200ms)、服务端排队、模型推理首Token延迟(TTFT,通常500ms-3s)及逐Token流式输出时间
1
Sources
50%
Confidence
Long-term
Relevance
8/19/2026
First Seen
Sources
Related Claims
UnverifiedAI系统实现200ms话轮延迟意味着完整链路需压缩在100-150ms内,考虑网络传输可能占用50ms以上77% similarPartially VerifiedAPI calls to large models typically incur latency of hundreds of milliseconds to several seconds, and response times are unstable due to multiple factors such as network conditions and server load.77% similarUnverifiedThe end-to-end latency of a real-time AI tutor is composed of three stacked segments: ASR latency (50–500ms), LLM first-token generation latency (100–2000ms), and TTS first audio frame latency (50–300ms).74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/772917API
curl https://kongchang.com/api/v1/knowledge/claims/772917MCP
get_claim(id=772917)