arXiv:2607.05352cs.CVcs.AI2026-07被引 3

首个支持多玩家互动的动态世界模型,能实时生成四人火箭联盟对战。

Multiplayer Interactive World Models with Representation Autoencoders

  • 通过多玩家动作流条件建模,精准区分不同玩家行为影响。
  • 50亿参数模型在单块B200 GPU上实现每秒20帧生成,推理时长达数小时不崩溃。
  • 开源数据集与代码,支持对物理理解能力的专项评估。

我们提出首个适用于高度动态、复杂物理交互环境的多人互动世界模型。与单玩家模型将其他智能体视为环境的一部分不同,本模型基于多个智能体的动作流进行条件建模,能够准确归因场景变化来源,并在任意动作组合下保持一致性。研究以火箭联盟游戏为场景,该游戏中玩家在快速、紧密耦合的动力学中竞争与合作。模型在10,000小时公开机器人收集的游戏数据上训练,采用50亿参数的隐空间扩散模型,可在单块Nvidia B200 GPU上实时生成四人对局,达到每秒20帧。尽管仅在短片段上训练,其滚动预测在长达五分钟内仍保持分布质量稳定,实际中可持续运行数小时无崩溃迹象。我们系统分析了视频编码器、生成目标和多人条件设计等核心选择,并研究了模型与数据规模对行为的影响,包括涌现能力与持续存在的失败模式。进一步开发了针对物理理解而非仅视觉外观的评估方法。为促进后续研究,我们发布数据集、完整训练与推理代码库及在线演示。

原文摘要 · Abstract (English)

We introduce the first multiplayer world model for highly dynamic environments governed by complex physical interactions. Whereas single-player world models treat the other agents as part of the environment, ours conditions on the action streams of multiple agents, learning to attribute changes in the scene to the correct player and to stay coherent under arbitrary combinations of their actions. We study this problem in the game of Rocket League, where players compete and cooperate under fast, tightly coupled dynamics. Trained on 10,000 hours of gameplay collected with publicly available bots, our 5-billion-parameter latent diffusion model generates four-player matches in real time, producing 20 frames per second on a single Nvidia B200 GPU. Although trained only on short clips, its rollouts stay stable far beyond the training horizon: distributional quality holds steady out to five minutes, the longest horizon we measure, and in practice we observe rollouts continuing for hours with no sign of collapse. We systematically investigate the central design choices: the video codec, the generative objective, and the multiplayer conditioning scheme. In addition, we characterize how behavior changes with model and data scale, including the capabilities that emerge and the failure modes that persist. We further develop targeted evaluations that probe the model's physical understanding rather than visual appearance alone. To support continued research on multiplayer world models, we release our dataset, our full training and inference codebase, and a live demo.

世界模型多智能体扩散模型强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。