arXiv:2606.20545cs.CV2026-06被引 5

现有世界模型缺乏持续演化的内在状态,无法真实模拟无人观测时的物理进程。

Current World Models Lack a Persistent State Core

论文配图:Current World Models Lack a Persistent State Core
图 1 · 摘自论文原文
  • 通过干预观测性设计新基准WRBench,检验模型在未被观察时是否持续演化
  • 9600段视频测试显示,所有模型均在未观测时中断事件,返回时仅恢复原状态
  • 该缺陷跨模型、控制范式和规模普遍存在,提示需将状态一致性设为首要目标

世界模型被视为迈向通用人工智能的关键一步,但建模物理世界不仅需生成逼真画面,更需具备随时间持续演化的内部状态,使物体存在且事件自然推进,即使无观测也如此——如月亮在无人注视时仍沿轨道运行。现有评估基准忽视此点,仅奖励画面保真度、运动流畅性和相机可控性,从不检验生成世界在未被观察时是否持续演化。本文提出首个系统性诊断基准WRBench,将相机运动视为对可观测性的干预,构建人类校准的评估链:检查相机是否执行请求动作,场景在可视时是否连续可辨,返回目标是否与启动事件一致。基于23个模型、4种控制范式、共9600段视频的测试发现,当前系统仅将观测世界当作跟踪镜头,当目标离开视野后,返回时仅恢复其被放弃的状态,而非继续推进事件进程。这一失败在不同控制范式、模型族及参数量增长下反复出现,表明清晰图像、精确控制、丰富几何先验或更大参数量均不足以带来稳定的世界状态演化。因此我们主张,物理状态内核的稳定性与视点切换下世界线的一致性应成为世界模型设计的首要目标,使其捕捉世界如何展开,而不仅是下一帧如何呈现。

原文摘要 · Abstract (English)

World models are increasingly regarded as a decisive step toward artificial general intelligence, yet modeling the physical world demands more than rendering convincing frames on demand: it requires an internal world state that keeps evolving over time, decoupled from observation, so that objects endure and events run to their conclusions whether or not a camera is watching, much as the moon holds to its orbit when no one is looking. This requirement is a blind spot of existing benchmarks, which reward surface properties such as fidelity, motion, and camera controllability while never asking whether a generated world keeps evolving once it is unobserved. We introduce \textbf{WRBench}, the first systematic diagnostic benchmark that treats camera motion as an intervention on observability and resolves evaluation into a human-calibrated chain that asks whether the camera executes the requested interaction, whether the scene stays continuous and identifiable while in view, and whether a returning target remains consistent with the event that was set in motion. Across 9{,}600 videos from 23 models spanning four control paradigms, one finding proves stubborn: current systems maintain the observed world as a tracking shot, resuming a returning target in the state at which it was abandoned rather than advancing the event while it went unseen. Because this failure recurs across control paradigms, model families, and increments of scale, robust world-state evolution does not follow from cleaner imagery, tighter control, richer geometric priors, or sheer parameter count We therefore argue that the stability of the physical state kernel and the consistency of worldlines under viewpoint intervention should become first-class objectives of world-model design, so that a world model captures how the world will unfold rather than how the next frame appears.

世界模型状态演化评估基准物理一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。