Unverified50% confidenceBenchmarkExact time
In CLM experiments, the accuracy of selecting the correct tool from 8 tools was 86%, but dropped sharply to 17% when selecting from all 1,080 tools, with the main error being confusion between tools with similar names; TiFF is limited to a maximum of 255 options.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/4/2026
First Seen
Valid until: 1/2/2027
Sources
Related Entities
Related Claims
UnverifiedThe 29-million-parameter encoder trained by the researchers achieved a popularity-weighted cross-fold AUC of only 0.486 on 985 statements, indistinguishable from the corpus prior.67% similarUnverified在工具数量超过20个的场景下，工具描述的语义歧义度与模型选择准确率之间存在显著的负相关关系66% similarUnverifiedIn the configuration using ten policy snapshots, using only 8 prompts achieved an average accuracy of 24.09%, approaching the 24.51% achieved with 14,080 prompts.66% similarUnverifiedThe relationship between the standard error of Monte Carlo estimation and the number of simulations N is that the standard error is proportional to 1/√N.63% similarUnverifiedThe more detailed the answers provided to the AI during the requirements analysis phase, the lower the probability of bugs in the final product; the cost of fixing errors found in the requirements phase is only 1/10 to 1/100 of the cost of finding the same type of error in the coding phase.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/973481API
curl https://kongchang.com/api/v1/knowledge/claims/973481MCP
get_claim(id=973481)