让AI像人一样共情他人,主动做出利他决策。
Autonomous Alignment with Human Value on Altruism through Considerate Self-imagination and Theory of Mind
- 用自我想象和心理理论构建共情能力
- 在救人场景中平衡自保与助人,避免副作用
- 适合研究安全可控的智能体决策
随着人工智能在社会中的广泛应用,使其自主对齐人类价值观成为确保可持续发展和造福人类的关键。其中,使智能体能自主做出利他、安全、合乎伦理的决策至关重要。当前AI过度追求任务表现,对环境与其他主体漠不关心,引发诸多安全风险。人类的利他行为源于共情能力,即心理理论(Theory of Mind, ToM),并结合行动前的预测性想象,形成深思熟虑的利他行为。受此启发,本文致力于赋予智能体考虑性自我想象与心理理论能力,通过隐式内在动机驱动其自主对齐人类利他价值观。通过将心理理论融入想象空间,智能体可实时关注其他主体福祉,主动预判自身及他人潜在风险,作出兼顾负面效应的深思熟虑的利他决策。以中国古代‘司马光砸缸’故事为原型设计实验场景及其变体,反映自利目标、利他救援与规避副作用之间的权衡与综合考量。
原文摘要 · Abstract (English)
With the widespread application of Artificial Intelligence (AI) in human society, enabling AI to autonomously align with human values has become a pressing issue to ensure its sustainable development and benefit to humanity. One of the most important aspects of aligning with human values is the necessity for agents to autonomously make altruistic, safe, and ethical decisions, considering and caring for human well-being. Current AI extremely pursues absolute superiority in certain tasks, remaining indifferent to the surrounding environment and other agents, which has led to numerous safety risks. Altruistic behavior in human society originates from humans' capacity for empathizing others, known as Theory of Mind (ToM), combined with predictive imaginative interactions before taking action to produce thoughtful and altruistic behaviors. Inspired by this, we are committed to endow agents with considerate self-imagination and ToM capabilities, driving them through implicit intrinsic motivations to autonomously align with human altruistic values. By integrating ToM within the imaginative space, agents keep an eye on the well-being of other agents in real time, proactively anticipate potential risks to themselves and others, and make thoughtful altruistic decisions that balance negative effects on the environment. The ancient Chinese story of Sima Guang Smashes the Vat illustrates the moral behavior of the young Sima Guang smashed a vat to save a child who had accidentally fallen into it, which is an excellent reference scenario for this paper. We design an experimental scenario similar to Sima Guang Smashes the Vat and its variants with different complexities, which reflects the trade-offs and comprehensive considerations between self-goals, altruistic rescue, and avoiding negative side effects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。