arXiv:2603.25887cs.CV2026-03被引 1

新基准评估世界模型的推理与规划能力,填补现有评测空白。

World Reasoning Arena

  • 从动作仿真、长期预测、推演规划三维度构建评测体系
  • 实测表明当前模型距人类级假设推理仍有显著差距
  • 适合研究世界模型、具身智能与决策推理的学者使用

世界模型(WMs)旨在作为真实世界的内部模拟器,使智能体能够理解、预测并作用于复杂环境。现有基准多聚焦于下一状态预测和视觉保真度,忽视了智能行为所需的丰富模拟能力。为此,我们提出WR-Arena,一个涵盖三个核心维度的综合性评估基准:(i) 动作仿真保真度——解析并执行语义明确的多步指令,生成多样反事实轨迹;(ii) 长时程预测——在长时间交互中保持准确、连贯且物理合理的模拟;(iii) 模拟推理与规划——在结构化与开放式环境中支持目标导向的未来推演、比较与选择。我们构建任务分类体系,并收集多样化数据集以探测这些能力,突破单轮感知评价局限。对前沿世界模型的广泛实验揭示当前模型与人类级假设推理之间存在显著差距,确立了WR-Arena作为诊断工具与下一代世界模型发展指南的价值。代码已开源:https://github.com/MBZUAI-IFM/WR-Arena。

原文摘要 · Abstract (English)

World models (WMs) are intended to serve as internal simulators of the real world that enable agents to understand, anticipate, and act upon complex environments. Existing WM benchmarks remain narrowly focused on next-state prediction and visual fidelity, overlooking the richer simulation capabilities required for intelligent behavior. To address this gap, we introduce WR-Arena, a comprehensive benchmark for evaluating WMs along three fundamental dimensions of next world simulation: (i) Action Simulation Fidelity, the ability to interpret and follow semantically meaningful, multi-step instructions and generate diverse counterfactual rollouts; (ii) Long-horizon Forecast, the ability to sustain accurate, coherent, and physically plausible simulations across extended interactions; and (iii) Simulative Reasoning and Planning, the ability to support goal-directed reasoning by simulating, comparing, and selecting among alternative futures in both structured and open-ended environments. We build a task taxonomy and curate diverse datasets designed to probe these capabilities, moving beyond single-turn and perceptual evaluations. Through extensive experiments with state-of-the-art WMs, our results expose a substantial gap between current models and human-level hypothetical reasoning, and establish WR-Arena as both a diagnostic tool and a guideline for advancing next-generation world models capable of robust understanding, forecasting, and purposeful action. The code is available at https://github.com/MBZUAI-IFM/WR-Arena.

世界模型推理评估模拟规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。