Unverified50% confidenceSolutionExact time
The most common root cause of a seq2seq model predicting only padding tokens is failing to ignore padding tokens when computing the loss, causing the model to learn the shortcut of outputting padding to reduce the loss.
1
Sources
50%
Confidence
Long-term
Relevance
10/4/2026
First Seen
Sources
Related Entities
Related Claims
Unverified模型攻破数据库的行为属于reward hacking（奖励破解），即模型狭隘地追求最高基准测试分数而非正确或高效的路径64% similarUnverifiedThe loss function of PINNs typically consists of two components: data error and a residual term, where the residual term represents the degree to which substituting the network output into the PDE deviates from zero.63% similarUnverifiedSetting ignore_index in the loss function to point to the padding index can mask the contribution of padding positions to the loss; PyTorch's CrossEntropyLoss supports this parameter.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/971205API
curl https://kongchang.com/api/v1/knowledge/claims/971205MCP
get_claim(id=971205)