对比世界模型与传统模拟器,揭示其在物理真实性与状态反馈上的差距
From Generation to Simulation: How Far Are World Models from Being True Simulators?

- 基于8项模拟器能力评估200篇论文,划分三类技术路线
- 仅交互与可控性实现特定场景替代,长期演化稳定性不足
- 强调状态反馈缺失,提出6个关键研究方向
随着扩散模型和大规模视频生成的快速发展,生成式世界模型被寄予厚望,期望取代传统模拟器(如物理引擎、游戏引擎、强化学习环境)。然而,从生成到真正模拟之间的差距缺乏系统性评估。本文采用外部标准,基于传统模拟器的八项核心能力——资产构建、物理引擎、交互、可控性、稳定性、状态反馈、多样性及评估指标——开展能力评估。我们梳理了三种主要技术路径:隐空间动力学、视频生成与联合嵌入预测,并将2018年至2026年6月间发表的200篇代表性工作映射至这些能力维度。分析显示,世界模型在特定场景中已实现交互与可控性的功能替代,但在物理定律的形式化保证、结构化状态反馈以及可复现的长时序演化方面仍远未达到传统模拟器水平。状态反馈是跨路径最被忽视的短板:200篇实现论文中仅有6篇提供运行时接口以查询实体状态或物理参数。据此,我们识别出六个关键研究方向:形式化物理、统一动作接口、首等状态反馈、长时稳定性、下游实用性评估及跨路径混合建模。
原文摘要 · Abstract (English)
With the rapid progress of diffusion models and large-scale video generation, generative world models are increasingly expected to replace traditional simulators, including physics engines, game engines, and reinforcement-learning environments. Yet the remaining distance from generation to simulation lacks a systematic assessment. We present a capability-based study using an external yardstick: eight capabilities of a traditional simulator, namely asset construction, physics engine, interaction, controllability, stability, state feedback, diversity, and evaluation metrics. We trace three main technical routes--latent dynamics, video generation, and joint-embedding prediction--and map exactly 200 representative works published from 2018 to June 2026 onto these capabilities. Our analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution. State feedback is the most neglected cross-route shortcoming: only 6 of 163 implementation papers expose a runtime interface for querying entity states or physical parameters. We identify six research directions: formalized physics, a unified action interface, first-class state feedback, long-horizon stability, downstream-utility evaluation, and cross-route hybridization. Project page: https://github.com/AtongWang/world-model-simulators
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。