让智能体通过推断他人意图实现无需沟通的协作
Theory of Mind Using Active Inference: A Framework for Multi-Agent Cooperation
- 用主动推理框架构建可推断他人信念与目标的智能体
- 在避障和觅食任务中协作效果优于无心智理论的智能体
- 仅凭观察行为推断他人意图,适合复杂多智能体系统
心智理论(ToM)指理解他人可能拥有不同知识与目标的能力,使智能体在规划自身行为时能推理他人的信念。本文提出一种基于主动推理的多智能体协作新方法,无需任务特定的共享生成模型或显式通信。智能体通过维护自我与他人信念、目标的独立表征,利用改进的基于推理树的规划算法,递归探索联合策略空间。在碰撞避免与觅食模拟中,具备心智理论的智能体相比非心智理论智能体表现出更优协作能力,能有效避免碰撞并减少重复努力。关键在于,心智理论智能体仅通过观察他人行为推断其信念,并据此规划自身行动。该方法为可泛化、可扩展的多智能体系统提供了潜力,同时揭示了心智理论机制的计算本质。
原文摘要 · Abstract (English)
Theory of Mind (ToM) -- the ability to understand that others can have differing knowledge and goals -- enables agents to reason about others' beliefs while planning their own actions. We present a novel approach to multi-agent cooperation by implementing ToM within active inference. Unlike previous active inference approaches to multi-agent cooperation, our method neither relies on task-specific shared generative models nor requires explicit communication. In our framework, ToM-equipped agents maintain distinct representations of their own and others' beliefs and goals. ToM agents then use an extended and adapted version of the sophisticated inference tree-based planning algorithm to systematically explore joint policy spaces through recursive reasoning. We evaluate our approach through collision avoidance and foraging simulations. Results suggest that ToM agents cooperate better compared to non-ToM counterparts by being able to avoid collisions and reduce redundant efforts. Crucially, ToM agents accomplish this by inferring others' beliefs solely from observable behaviour and considering them when planning their own actions. Our approach shows potential for generalisable and scalable multi-agent systems while providing computational insights into ToM mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。