arXiv:2509.05091cs.AIcs.MA2025-09ACL被引 1

让AI通过理解他人意图,精准提供建议来促进合作。

ProToM: Promoting Prosocial Behaviour via Theory of Mind-Informed Feedback

  • 用贝叶斯逆向规划推断智能体目标,再选最优反馈
  • 在两个环境里成功率更高,完成时间更短
  • 适合需要高效协作的多智能体系统研究

人类虽天生具有社会性,但在追求独立目标时,往往难以判断何时何地应协助或合作。为解决这一问题,我们提出ProToM——一种基于心智理论的反馈机制,旨在多智能体系统中通过针对性、上下文敏感的反馈促进利他行为(即不直接符合自身目标但仍有益于他人的行为)。ProToM首先利用贝叶斯逆向规划推断智能体的目标分布,再基于该分布最大化预期效用,选择最优反馈信息。我们在两个多智能体环境(Doors, Keys, and Gems 和 Overcooked)中评估该方法,结果表明:当前最先进的大语言与推理模型在反馈沟通上存在时机不当、缺乏上下文关联的问题,导致通信开销高且任务提速有限;而ProToM能提供精准且有帮助的反馈,在成功率、任务完成时间上表现更优,并获得人类用户一致青睐。

原文摘要 · Abstract (English)

While humans are inherently social creatures, the challenge of identifying when and how to assist and collaborate with others - particularly when pursuing independent goals - can hinder cooperation. To address this challenge, we aim to develop an AI system that provides useful feedback to promote prosocial behaviour - actions that benefit others, even when not directly aligned with one's own goals. We introduce ProToM, a Theory of Mind-informed facilitator that promotes prosocial actions in multi-agent systems by providing targeted, context-sensitive feedback to individual agents. ProToM first infers agents' goals using Bayesian inverse planning, then selects feedback to communicate by maximising expected utility, conditioned on the inferred goal distribution. We evaluate our approach against baselines in two multi-agent environments: Doors, Keys, and Gems, as well as Overcooked. Our results suggest that state-of-the-art large language and reasoning models fall short of communicating feedback that is both contextually grounded and well-timed - leading to higher communication overhead and task speedup. In contrast, ProToM provides targeted and helpful feedback, achieving a higher success rate, shorter task completion times, and is consistently preferred by human users.

多智能体心智理论合作反馈机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。