Unverified50% confidenceBenchmarkExact time
Paired statistics (n=107) show 99 agreements, 2 cases where Swift was better, and 6 cases where it was worse; McNemar's exact test yielded p≈0.29, making the quality of the two statistically indistinguishable.
1
Sources
50%
Confidence
Long-term
Relevance
9/25/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe accuracy data in the test has an error margin of approximately ±8–10 percentage points at n=100 sample size (based on a 95% confidence-level binomial confidence interval).74% similarUnverifiedMcNemar 检验关注两个模型在每个样本上的分歧情况，只有判断结果不一致的样本（b和c单元格）具有信息量，两者都对或都错的样本被视为无关信息69% similarUnverifiedThe Matthews Correlation Coefficient (MCC) takes into account true positives, true negatives, false positives, and false negatives, with a value range of [-1, 1], and is more robust to class imbalance problems than accuracy.69% similarUnverified对同一测试用例执行多次调用统计成功比例得到通过率，比二元的通过/失败判断更能反映模型真实表现68% similarUnverifiedThe study used Kendall's W statistic to measure ranking consistency across different tools, yielding W=0.07, p=0.83, which is almost indistinguishable from random coin flipping.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/951069API
curl https://kongchang.com/api/v1/knowledge/claims/951069MCP
get_claim(id=951069)