Unverified50% confidenceFactExact time
The GPT-4o-mini few-shot configuration had only one confidence value before and after calibration, and its correctness AUROC was only 0.500, indicating that the model has almost no ability to distinguish correct from incorrect predictions.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/23/2026
First Seen
Valid until: 1/21/2027
Sources
Related Entities
Related Claims
UnverifiedThe Spearman correlation coefficient between tool description scores and correct model selection was only 0.04, with almost no statistical association.75% similarUnverified仅用小模型策略的每正确答案成本最低($0.0004)但准确率仅33%，说明没有准确率底线的每正确答案成本指标具有误导性73% similarUnverifiedIn the selective classification framework, when model confidence is below the threshold τ=0.934, the sample is rejected and referred to an expert for review.73% similarUnverifiedCorrectness AUROC measures the ability of a model to distinguish "correct prediction" from "incorrect prediction", with a value of 0.5 indicating no discriminative power and 1.0 indicating perfect discrimination; it is a threshold-independent metric.71% similarVerifiedA 2023 Stanford University study showed that multimodal models such as GPT-4V, when parsing flowcharts with nested conditional logic, had accuracy approximately 15–25 percentage points lower than equivalent textual descriptions.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1088395API
curl https://kongchang.com/api/v1/knowledge/claims/1088395MCP
get_claim(id=1088395)