Unverified50% confidenceSolutionExact time
TRACER designs hierarchical rewards that provide reward signals at both the outcome level and the trajectory level, combined with bias-aware advantage modulation to mitigate reward sparsity and credit assignment problems.
1
Sources
50%
Confidence
Long-term
Relevance
9/25/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe greatest risk of self-improvement comes from the reward signal itself: if the reward is improperly defined, the agent will optimize evaluation metrics rather than the true objective (the reinforcement learning version of Goodhart's Law).74% similarUnverified推荐奖励常见模式包括单边奖励、双边奖励、阶梯式奖励和里程碑解锁73% similarUnverifiedReward Shaping guides the learning direction by designing intermediate rewards, such as setting each point of damage dealt to a boss as an intermediate reward.72% similarUnverifiedHuman annotators exhibit a cognitive bias toward more information being better when evaluating answers, causing reward models to implicitly link length with quality, which is one of the causes of model verbosity.69% similarUnverified排行榜作为游戏化元素能激发竞争动机，但也可能导致排名靠后的参与者产生挫败感而退出69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/949070API
curl https://kongchang.com/api/v1/knowledge/claims/949070MCP
get_claim(id=949070)