Unverified50% confidenceSolutionExact time
Insufficient sampling times for SHAP values leads to unstable attribution results, manifested as fluctuations in feature rankings across runs; it is recommended to increase the sampling times or use DeepSHAP, and to report confidence intervals for the attributions.
1
Sources
50%
Confidence
Long-term
Relevance
10/20/2026
First Seen
Sources
Related Entities
Related Claims
Verified若用含测试集的全量数据计算均值和标准差，会导致预处理泄漏，使评估指标虚高，无法真实反映模型泛化能力77% similarUnverifiedWhen different raters understand the same level very differently, the Likert scale leads to unstable inter-rater reliability, and a single number cannot carry information about specific good and bad dimensions.75% similarUnverifiedIgnoring error correlation causes the combined variance to be underestimated, and the underestimation factor grows with group size; this factor accurately predicts the degree of coverage failure.75% similarVerifiedSome models carry the risk of over-optimization toward test sets, causing leaderboard scores to deviate from real-world performance (benchmark saturation).74% similarUnverifiedSome vendors tend to over-optimize for evaluation sets (benchmark gaming/benchmark contamination), leading to inflated scores but insufficient generalization ability.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1074557API
curl https://kongchang.com/api/v1/knowledge/claims/1074557MCP
get_claim(id=1074557)