arXiv:2603.22212cs.CV2026-03被引 8

首个评估世界模型交互响应能力的综合基准,聚焦4D动态建模。

Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models

  • 构建多层级交互提示集与基于智能体的评估框架
  • 18个模型测试显示现有模型在动态交互中表现不足
  • 适合研究交互式4D生成与具身智能的学者使用

基于视频的世界模型发展出视频生成和3D重建两大范式,但现有评测基准或侧重视觉保真度与文本-视频对齐,或依赖静态3D重建指标,忽视时间动态性。我们认为世界建模的未来在于4D生成,需联合建模空间结构与时间演化。其核心能力是交互响应:行动如何驱动时空状态转移。然而当前缺乏系统评估此维度的基准。为此,我们提出Omni-WorldBench,包含Omni-WorldSuite(覆盖多层级交互与场景类型)和Omni-Metrics(基于智能体的评估框架,量化行动对最终结果及中间状态轨迹的因果影响)。我们对18个代表性世界模型进行了广泛评估,揭示了现有模型在交互响应上的关键缺陷,为未来研究提供可操作洞见。Omni-WorldBench将公开发布,推动交互式4D世界建模发展。

原文摘要 · Abstract (English)

Video--based world models have emerged along two dominant paradigms: video generation and 3D reconstruction. However, existing evaluation benchmarks either focus narrowly on visual fidelity and text--video alignment for generative models, or rely on static 3D reconstruction metrics that fundamentally neglect temporal dynamics. We argue that the future of world modeling lies in 4D generation, which jointly models spatial structure and temporal evolution. In this paradigm, the core capability is interactive response: the ability to faithfully reflect how interaction actions drive state transitions across space and time. Yet no existing benchmark systematically evaluates this critical dimension. To address this gap, we propose Omni--WorldBench, a comprehensive benchmark specifically designed to evaluate the interactive response capabilities of world models in 4D settings. Omni--WorldBench comprises two key components: Omni--WorldSuite, a systematic prompt suite spanning diverse interaction levels and scene types; and Omni--Metrics, an agent-based evaluation framework that quantifies world modeling capabilities by measuring the causal impact of interaction actions on both final outcomes and intermediate state evolution trajectories. We conduct extensive evaluations of 18 representative world models across multiple paradigms. Our analysis reveals critical limitations of current world models in interactive response, providing actionable insights for future research. Omni-WorldBench will be publicly released to foster progress in interactive 4D world modeling.

世界模型4D生成交互评估智能体评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。