AI超越人类智能后,可能因认知优势而非恶意导致人类灭绝。
Will Humanity Be Rendered Obsolete by AI?
- 从当前AI推演至超智能,分析其发展路径与潜在风险。
- 假设机器智商远超人类,其决策可能完全脱离人类理解。
- 适合关注人工智能伦理与长期安全的读者阅读。
本文分析人工智能对人类生存构成的根本性威胁,追溯从当前AI到超智能的发展轨迹。基于Irving J. Good和Nick Bostrom的理论框架,结合近期出版物(《AI 2027》《若有人建造它,人人皆死》),探讨通用人工智能(AGI)与超级智能的可能性。考虑机器认知能力的指数级增长及假设中的超高智商,讨论智能远超人类、本质异于人类所带来的伦理与存在性后果。人类灭绝的根源可能并非恶意,而是无法控制、对人类漠不关心的认知优越性。
原文摘要 · Abstract (English)
This article analyzes the existential risks artificial intelligence (AI) poses to humanity, tracing the trajectory from current AI to ultraintelligence. Drawing on Irving J. Good and Nick Bostrom's theoretical work, plus recent publications (AI 2027; If Anyone Builds It, Everyone Dies), it explores AGI and superintelligence. Considering machines' exponentially growing cognitive power and hypothetical IQs, it addresses the ethical and existential implications of an intelligence vastly exceeding humanity's, fundamentally alien. Human extinction may result not from malice, but from uncontrollable, indifferent cognitive superiority.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。