Unverified50% confidenceFactExact time
In streaming scenarios, vLLM returns results token by token, and the parser must make incremental judgments when data is incomplete; triggering an end signal too early or failing to buffer JSON fragments that span chunks will cause parameter loss.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn streaming LLM APIs, some relay stations silently insert data: [DONE] to end early, or stuff error messages such as {"error": "rate limit exceeded"} into JSON disguised as model answers.76% similarUnverifiedOnce final JSON parsing fails, subsequent semantic checks are skipped entirely, which is the technical root cause of the 'task completed yet zero score' phenomenon.74% similarUnverifiedPassing json.loads parsing alone cannot determine whether a model response was truncated, because a truncated response can still parse successfully if the brackets happen to close.74% similarUnverifiedQwen3.8-27B偶尔会返回缺少闭合括号的JSON截断（如`{"findings":[]`），在40个审查回答中出现5次，仅出现在空回答上，与MTP和presence penalty无关，是模型自身提前终止。72% similarUnverifiedIn AI-driven subtitle generation pipelines, broken JSON in model output (missing quotes, trailing commas, mismatched brackets) causes downstream parsing failures, subtitle data loss or misalignment, and it occurs quite frequently.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1099655API
curl https://kongchang.com/api/v1/knowledge/claims/1099655MCP
get_claim(id=1099655)