Unverified50% confidenceDecision RuleExact time
When evaluating the effectiveness of AI recommendations, downstream metrics such as return rate, average order value and repurchase rate are more worth watching going forward, rather than looking only at engagement rate.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRefusal rate is a core quantitative metric in AI safety evaluation, referring to the proportion of requests in a specific category that a model explicitly declines to execute or avoids answering, usually tallied by human annotation or an automatic judge.72% similarUnverifiedTo decide whether to route to a smaller model, one should calculate the expected value: small model cost × success rate + (small model cost + large model cost) × fallback rate; when the fallback rate is high enough, routing directly to the large model is more cost-effective.72% similarUnverifiedAI judges show outcome bias when scoring: when only the run outcome is changed (while the Agent's decision process is the same), the AI judge gives a lower PROCESS score in the version where the outcome is wrong.71% similarUnverifiedIn the case, after AI self-verification it was found that the share of repayments allocated to fees was far higher than originally assumed, and principal was repaid much more slowly than in the simulation, causing the lump-sum payoff total to balloon to nearly twice the original estimate.71% similarUnverifiedResearch indicates that consumer satisfaction with customer service replies that are clearly AI-generated is on average 20%–30% lower than with human replies.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1099799API
curl https://kongchang.com/api/v1/knowledge/claims/1099799MCP
get_claim(id=1099799)