arXiv:2608.08600cs.CVcs.AI2026-08

让世界模型支持任意数量智能体实时扩展,无需重新训练。

Population-Scalable Multi-Agent World Modeling

论文配图:Population-Scalable Multi-Agent World Modeling
图 1 · 摘自论文原文
  • 用共享世界状态+统一渲染接口解耦环境演化与视觉生成
  • 推理时可扩展至任意数量智能体,实际性能近似线性增长
  • 适合构建可扩展的开放世界交互模拟系统

世界模型在视觉预测和交互生成方面取得显著进展,但扩展到多智能体环境时面临根本性可扩展性挑战。现有方法通常假设训练和推理阶段智能体数量固定,导致模型绑定于预设种群规模,限制了推理时的扩展能力。本文的核心洞察是:跨视角一致性应源于不依赖预设智能体数量的世界状态演化,而智能体特异性观测则通过统一渲染接口查询该状态生成。基于此,我们提出Khora——一种可扩展的多智能体世界模型,可在无需重训练的前提下支持推理时任意数量智能体的扩展。框架将世界状态演化与视觉渲染解耦,并引入无种群依赖的渲染机制以整合其他智能体信息。该设计通过共享世界状态而非视频生成器内密集的观察流交互来维持跨视角一致性,实现与查询视图数近似线性的实际扩展性能。定性实验表明,该方法可泛化至未见过的智能体数量,同时保持视觉质量和多智能体一致性。我们进一步构建了一个实时交互系统,验证其在可扩展开放世界模拟中的可行性。

原文摘要 · Abstract (English)

World models have recently achieved impressive progress in visual prediction and interactive generation, but extending them to multi-agent environments introduces a fundamental scalability challenge. Existing methods generally assume a fixed number of agents during training and inference, which ties the model to a pre-determined agent population and limits inference-time scalability. Our key insight is that cross-view consistency should arise from a shared world state whose evolution does not assume a predefined number of agents, while agent-specific observations should be generated by querying this state through a unified rendering interface. Based on this insight, we propose Khora, a scalable multi-agent world model that supports inference-time expansion to arbitrary numbers of agents without retraining. Our framework decouples world-state evolution from visual rendering and introduces a population-agnostic rendering mechanism for incorporating other agent information. This design maintains cross-view consistency through the shared world state rather than through dense interactions among observation streams inside the expensive video generator, enabling approximately linear practical scaling with the number of queried views. Qualitative experiments demonstrate that our approach generalizes to unseen numbers of agents while maintaining visual quality and multi-agent consistency. We further implement a real-time interactive system to demonstrate scalable open-world simulation.

多智能体世界模型可扩展性实时仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。