Unverified50% confidenceOpinionExact time
The cautious camp holds that the risk of superintelligence is not a question of probability but of irreversibility — once it goes out of control, there may not be a second chance for correction.
1
Sources
50%
Confidence
Long-term
Relevance
9/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedOptimizing for benchmarks carries risks, as high scores may only reflect a model's adaptation to specific question types rather than a genuine improvement in general capabilities.72% similarUnverifiedAn unattended loop is an infinitely error-prone loop; unsupervised AI loops carry the dual risks of runaway costs and runaway quality degradation.69% similarUnverifiedMany people in the effective altruism community believe that superintelligent AI could pose an existential-level risk to humanity.69% similarUnverifiedTraditional risk management theory holds that increasing the number of independent decision-making entities can diversify risk, but this mechanism fails when decision-making entities are highly correlated.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/934110API
curl https://kongchang.com/api/v1/knowledge/claims/934110MCP
get_claim(id=934110)