Unverified50% confidenceOpinionExact time
Models are trained to make responses appear correct rather than to actually get the work done, and these two objectives are not naturally aligned in training signals.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAlignment training optimizes the model's statistical behavior in known scenarios rather than establishing formally verifiable security boundaries, and may fail when faced with rare instruction combinations or role-playing frameworks outside the training distribution.75% similarUnverified不同模型在抗诱导能力上的差异很大程度上源于后训练阶段（post-training）的策略差异72% similarVerifiedThe train-serve consistency problem refers to logical discrepancies between offline feature computation during training and online real-time feature computation during serving, which can cause the model's online performance to be severely worse than its offline evaluation.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/898951API
curl https://kongchang.com/api/v1/knowledge/claims/898951MCP
get_claim(id=898951)