提出人与超智能共塑价值的协同对齐框架,应对超级智能失控风险。
Super Co-alignment of Human and AI for Sustainable Symbiotic Society
- 构建外部监督与内在主动对齐结合的双轨机制。
- 强调超智能需具备自我认知、反思与共情能力以自发理解人类意图。
- 适合关注安全可控超智能、伦理对齐的研究者与政策制定者。
随着人工智能向通用智能(AGI)乃至超级智能(ASI)演进,可能超越人类控制、偏离人类价值观,极端情况下引发不可逆灾难。这一风险凸显了‘超对齐’问题的重要性——确保远超人类智慧的AI系统仍与人类意图和价值观相兼容。现有可扩展监督与弱到强泛化方法虽具应用潜力,但存在根本缺陷:单向灌输人类价值观无法适应超智能的自主性,也难以保障AGI/ASI的稳定学习。本文主张,可持续共生社会的价值应由人类与活体AI共同塑造,实现‘超共对齐’。基于此愿景,提出整合外部监督与内在主动对齐的框架:外部监督以人类终极决策为核心,辅以可解释的自动化评估与修正,实现对人类动态价值观的持续对齐;内在主动对齐则基于对自我、他人与社会的深刻理解,融合自我意识、自省与共情,自发推断人类意图、分辨善恶并主动优先保障人类福祉。内外机制协同迭代,通过人-超智能共对齐过程,共同塑造共生价值与规则,为实现安全、有益的AGI与ASI铺平道路。
原文摘要 · Abstract (English)
As Artificial Intelligence (AI) advances toward Artificial General Intelligence (AGI) and eventually Artificial Superintelligence (ASI), it may potentially surpass human control, deviate from human values, and even lead to irreversible catastrophic consequences in extreme cases. This looming risk underscores the critical importance of the "superalignment" problem - ensuring that AI systems which are much smarter than humans, remain aligned with human (compatible) intentions and values. While current scalable oversight and weak-to-strong generalization methods demonstrate certain applicability, they exhibit fundamental flaws in addressing the superalignment paradigm - notably, the unidirectional imposition of human values cannot accommodate superintelligence's autonomy or ensure AGI/ASI's stable learning. We contend that the values for sustainable symbiotic society should be co-shaped by humans and living AI together, achieving "Super Co-alignment." Guided by this vision, we propose a concrete framework that integrates external oversight and intrinsic proactive alignment. External oversight superalignment should be grounded in human-centered ultimate decision, supplemented by interpretable automated evaluation and correction, to achieve continuous alignment with humanity's evolving values. Intrinsic proactive superalignment is rooted in a profound understanding of the Self, others, and society, integrating self-awareness, self-reflection, and empathy to spontaneously infer human intentions, distinguishing good from evil and proactively prioritizing human well-being. The integration of externally-driven oversight with intrinsically-driven proactive alignment will co-shape symbiotic values and rules through iterative human-ASI co-alignment, paving the way for achieving safe and beneficial AGI and ASI for good, for human, and for a symbiotic ecology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。