Unverified50% confidenceOpinionExact time
If models can understand and respond to negative signals, researchers can use this mechanism to guide model behavior to avoid harmful outputs.
1
Sources
50%
Confidence
Long-term
Relevance
9/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAfter alignment training eliminates a certain type of harmful output, the model may learn more subtle ways of expression.73% similarUnverifiedModels can be trained with a behavioral tendency of 'when uncertain, better not to act' as a risk-avoidance mechanism encoded into weights through reward signal design72% similarUnverified2024年已有安全研究者证明可以在不显著影响模型正常性能的前提下,通过微调在模型中植入特定触发模式,即模型后门攻击或木马模型71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/934959API
curl https://kongchang.com/api/v1/knowledge/claims/934959MCP
get_claim(id=934959)