arXiv:2605.31361cs.MAcs.AI2026-05中稿 · as a poster at the…

让智能体学会猜测队友行为,实现零样本协作。

Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learning

  • 将队友行为建模为世界模型中的可学习潜变量。
  • 通过理论心智头预测队友意图与动作,提升协作能力。
  • 适合需要快速适应新伙伴的多智能体系统研究者。

在合作式多智能体强化学习中,智能体需与内部策略和意图不可见的伙伴协同。尽管像Dreamer这样的世界模型在单智能体场景中表现出强泛化性和高采样效率,但在多智能体场景的应用受限于对队友引发的不确定性处理能力不足。本文提出新视角:将队友视为世界模型中可学习的结构化组件。我们设计了一种架构,将Dreamer风格的循环状态空间模型(RSSM)的潜变量分解为环境与队友两部分,并引入辅助的理论心智(ToM)头,从部分轨迹中推断伙伴的行为特征、意图及预测动作。这些队友潜变量用于条件化智能体的执行器与评价器,使其能够想象并适应多样化的合作者。本文还提出了零样本与少样本协作的支持方案,并设计了基准测试与评估协议以衡量其效果。该工作将世界模型不仅定位为环境动态的预测器,更扩展为社会行为的模拟器,为可泛化、类人智能的AI开辟新方向。

原文摘要 · Abstract (English)

In cooperative multi-agent reinforcement learning (MARL), agents must coordinate with partners whose internal policies and intentions are not directly observable. While world models such as Dreamer have demonstrated strong generalization and sample efficiency in single-agent settings, their application to MARL remains limited by an inability to handle teammate-induced uncertainty. We propose a new perspective: treat teammates as structured, learnable components within the agent's world model. We introduce an architecture that factorizes the latent state of a Dreamer-style recurrent state-space model (RSSM) into environment and teammate components, and learns an auxiliary Theory-of-Mind (ToM) head to infer latent embeddings of partner behavior such as character, intent, and predicted actions from partial trajectories. These teammate latents condition the actor and critic, enabling the agent to imagine and adapt to diverse collaborators. We outline how this approach can support zero-shot and few-shot coordination in partially observable settings and propose a set of benchmarks and evaluation protocols to assess its impact. This work positions world models as not only predictors of environmental dynamics, but as simulators of social behavior, opening new directions for generalizable, human-compatible AI.

多智能体世界模型协作理论心智

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。