Unverified50% confidenceBenchmarkExact time
In orchestration mode the local model scored 78/78 and 77/78; in single large-requirement mode it only got 76, 74, 71 (out of 78)
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAt the mention level, the model achieved an overall precision of 74.1% and a recall of 70.5%.65% similarUnverifiedAdding just one placeholder character to the system prompt alone can make a certain model jump from last place (58.2%) to first place (83.9%) on the same benchmark.65% similarUnverifiedIn the MemoryBench table, the scores of the five models are 85.5, 85.6, 79.0, 81.4, and 81.5 respectively, with a gap of only 0.1 points at the top.65% similarUnverifiedThe model's F1 score is 72%, and the data has a severe class imbalance with a ratio of 89:11.63% similarUnverifiedFor the 7B model, accuracy with the solver was 75.31% versus 72.02% for direct calculation, a paired improvement of +3.29 percentage points, with a 95% cluster interval of [-3.49, 10.38] crossing zero, making the advantage non-significant.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1048802API
curl https://kongchang.com/api/v1/knowledge/claims/1048802MCP
get_claim(id=1048802)