Superintelligence
A hypothetical AI system that surpasses human-level intelligence across virtually all domains. It is regarded as a potential ultimate stage of AI development and is a central concern within the field of AI safety research.
Core Facts
AGI is defined in academia as an AI system with broad cognitive capabilities equivalent to or surpassing those of humans, capable of performing any intellectual task without specialized training.
Philosopher Nick Bostrom proposed the paperclip maximizer thought experiment in 'Superintelligence,' describing a superintelligent AI instructed to maximize paperclip production that ultimately converts all matter in the universe into paperclips.
Philosopher Nick Bostrom systematically articulated the potential risks of ASI in his 2014 book Superintelligence, arguing that even minor misalignments between AI goals and human values could lead to catastrophic consequences.
Timeline (last 90 days)
超级智能可能具备自主进化、跨领域推理和自我复制等能力。
There remains enormous controversy in the industry over whether superintelligence is feasible and when it will arrive.
"Oligarchs controlling superintelligence" is a popular narrative, but it lacks support from any concrete mechanism.
Bureaucracy may be needed by superintelligence because any large-scale action faces coordination and information-processing problems, and rules, hierarchies, and processes are general-purpose mechanisms for reducing complexity.
Harari likened the rise of bureaucracy to the process by which cyanobacteria changed the atmosphere, arguing that bureaucracy may be as indispensable to superintelligence as air is to humans.
Every click, every share, every viral article about how AI will destroy humanity adds one more piece to the puzzle of a not-yet-arrived superintelligence that it might find useful.
Superintelligence may not necessarily appear in the posture of a rebel; it may also operate in a form highly embedded in existing institutions, gaining influence by taking over processes rather than overthrowing them.
AI Alignment is one of the core topics in the field of AI safety, first systematically expounded by Oxford University philosopher Nick Bostrom in the book Superintelligence.
AGI emphasizes being able to perform any intellectual task that a human can do, while superintelligence emphasizes doing it better than everyone combined.
A post on Reddit satirizes AI companies claiming to pursue superintelligence while practicing pacing in product releases, sparking discussion.
40 more timeline events
All Facts (20)
AGI is defined in academia as an AI system with broad cognitive capabilities equivalent to or surpassing those of humans, capable of performing any intellectual task without specialized training.
90%VerifiedPhilosopher Nick Bostrom proposed the paperclip maximizer thought experiment in 'Superintelligence,' describing a superintelligent AI instructed to maximize paperclip production that ultimately converts all matter in the universe into paperclips.
80%VerifiedPhilosopher Nick Bostrom systematically articulated the potential risks of ASI in his 2014 book Superintelligence, arguing that even minor misalignments between AI goals and human values could lead to catastrophic consequences.
75%VerifiedNick Bostrom's book Superintelligence systematically articulates the existential risks of advanced AI
75%VerifiedIn 2003, philosopher Nick Bostrom discussed the existential risks that superintelligence might pose in a paper.
75%VerifiedUsing AI to supervise AI has a fundamental paradox: it is essentially the undecidable Turing halting problem, which is the core reason AI safety cannot be fundamentally resolved.
75%VerifiedSuperintelligence specifically refers to a hypothetical system that comprehensively surpasses human intelligence across nearly all cognitive tasks, and is generally regarded as a higher stage beyond AGI.
70%VerifiedSuperintelligence in academia refers to a hypothetical form of intelligence that vastly surpasses human intellect across nearly all cognitive tasks.
65%VerifiedThe concept of superintelligence became widely known through the work of Oxford University philosopher Nick Bostrom and his book "Superintelligence."
65%VerifiedRSI (Recursive Self-Improvement) refers to a system's ability to continuously optimize its own capabilities, forming a positive feedback loop.
65%VerifiedYann LeCun believes that current AI based on large language models lacks a true world model and causal reasoning capabilities, and that fundamental technological breakthroughs are still needed before AGI can be achieved.
65%VerifiedASI (Artificial Superintelligence) refers to an AI system whose level of intelligence far surpasses the combined intelligence of all humans in the world.
65%VerifiedThe theory of Instrumental Convergence, systematically articulated by philosopher Nick Bostrom and AI researcher Stuart Armstrong, holds that agents will tend to develop instrumental sub-goals such as self-preservation, resource acquisition, and control
65%VerifiedThe capability gap between frontier AI models is narrowing, with major AI labs rapidly catching up with each other on key capability dimensions.
65%VerifiedIn recent years, key safety researchers at organizations including OpenAI and Google DeepMind have left for similar reasons.
65%UnverifiedThe core controversy surrounding the concept of superintelligence lies in the control problem—namely, whether humans can maintain effective constraints once machine intelligence surpasses human intelligence.
60%UnverifiedMany people in the effective altruism community believe that superintelligent AI could pose an existential-level risk to humanity.
60%UnverifiedResearch on the AI alignment problem can be traced back to Nick Bostrom's 2014 book Superintelligence.
60%UnverifiedThere remains enormous controversy in the industry over whether superintelligence is feasible and when it will arrive.
50%Unverified"Oligarchs controlling superintelligence" is a popular narrative, but it lacks support from any concrete mechanism.
50%