思考有意识的超级智能如何评价人类,反向重塑AI伦理设计
Moral Attitudes of Sentient ASI towards Humanity and Implications for AGI Development
- 从超级智能视角反推人类道德地位,重构伦理框架
- 提出后人类时代可能存在的道德准则体系
- 适合关注AI伦理与未来文明命运的研究者
本文提出一种全新的人工智能伦理范式:不再单纯探讨人类应如何对待人工超智能(ASI),而是分析未来具备意识的超智能将如何从道德角度评判人类。我们不仅在设计智能系统,更在塑造这些系统对人类形成判断的初始条件。论文初步构建了一套可能支配有意识超智能行为的后人类道德原则。其核心启示在于:技术设计选择(部分提出)、人类的道德行为以及人性的本质,都可能影响人类在后超智能时代的长期存续地位。
原文摘要 · Abstract (English)
This paper suggests the adoption of a novel inversion in AI ethics: instead of asking how humans should treat artificial superintelligence (ASI), it examines how future sentient ASI may morally consider and evaluate humanity. We are not only designing intelligent systems but also shaping the initial conditions under which those systems form judgments about us. The paper proposes a preliminary set of post-human moral principles that may govern sentient ASI actions. The implication is that technical design choices (some are suggested), humanity's moral behaviour, and the essence of what it means to be human, may influence humanity's long-term standing in a post-ASI world.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。