让智能体通过对话对齐世界模型,提升协作效率。
Embodied Multi-Agent Coordination by Aligning World Models Through Dialogue

- 用自然语言对话让部分观测的智能体共享信息、对齐认知
- 对话使动作冲突降低40%至83%,但任务成功率下降
- 提出三维度评估框架,揭示当前模型仅实现表面协作
embodied agents 的有效协作不仅需要共享环境中的行为,更需基于各自动态演化的世界理解进行沟通。当智能体只能部分观测环境时,无沟通的协调在理论上极为困难,而沟通可借助信息共享实现世界模型对齐。本文扩展 PARTNR 基准,引入自然语言对话通道,使两个具有部分可观测性的智能体在任务执行中可沟通。为评估对话是否带来真实的世界模型对齐而非表面协作,我们提出基于个体世界图的对齐度量框架:观察收敛性(私有世界模型是否随时间趋同)、信息新颖性(消息是否传递对方缺失的信息)、信念敏感性(智能体是否考虑对方已知内容)。在三个 LLM 上的实验表明,对话使动作冲突减少 40 至 83 个百分点,但任务成功率反而下降。通过该框架,我们刻画了表面协作与真实对齐之间的差距,并定位了当前模型所处位置。
原文摘要 · Abstract (English)
Effective collaboration between embodied agents requires more than acting in a shared environment; it demands communication grounded in each agent's evolving understanding of the world. When agents can only partially observe their surroundings, coordination without communication is provably hard, but communication can, in principle, bridge this gap by allowing agents to share observations and align their world models. In this work, we examine whether LLM-based embodied agents actually realize the ability to communicate. We extend PARTNR, a benchmark for collaborative household robotics, with a natural-language dialogue channel that enables two agents with partial observability to communicate during task execution. To evaluate whether dialogue leads to genuine world-model alignment rather than superficial coordination, we propose a framework for measuring world-model alignment defined over per-agent world graphs: observation convergence (do private world models align over time?), information novelty (do messages convey what the partner lacks?), and belief-sensitive messaging (do agents model what their partner knows?). Our experiments across three LLMs reveal that dialogue reduces action conflicts 40 to 83 percentage points but degrades task success relative to silent coordination. Using our metrics, we characterize the gap between superficial coordination and genuine world-model alignment, and identify where current models fall on this spectrum. Project Website: https://uiuc-conversational-ai-lab.github.io/partnr-dial-wmd/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。