Unverified50% confidenceFactExact time
The correction method tested by the researchers—averaging each answer with the complement of its paired answer—restores complementary consistency by construction and lowers Brier loss averaged over the two phrasings.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAccording to the study's description, this processing noticeably improves the model's accuracy and consistency of judgment on samples involving binary payloads—the blind spot is partially filled.73% similarUnverifiedThe inconsistency score in the study is calculated as follows: compute pairwise similarities between baseline IPA transcriptions, compute pairwise similarities between corresponding phonetic codes, and take the absolute difference between the two, using normalized edit distance as the similarity measure.71% similarUnverified对同一测试用例执行多次调用统计成功比例得到通过率，比二元的通过/失败判断更能反映模型真实表现70% similarUnverifiedThe two hard zeros for graph retrieval in the benchmark were because the grader required exact wording while the model paraphrased; the README documents every point lost.70% similarUnverifiedWhen researchers run different testing frameworks using the same model, scores often fluctuate noticeably.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1098438API
curl https://kongchang.com/api/v1/knowledge/claims/1098438MCP
get_claim(id=1098438)