arXiv:2608.27345cs.CVcs.AI2026-08

提出评估视频生成模型分布一致性的新标准与基准。

PAWBench: How Far Are We from Probabilistically Aligned World Modeling?

论文配图:PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
图 1 · 摘自论文原文
  • 定义分布一致性为世界模型的核心要求,强调生成多样性。
  • 在50个场景中测试11个模型,无一稳定匹配真实行为分布。
  • 适合关注视频生成可信度与可控性的研究者参考。

近期视频生成模型被越来越多视为世界模型。许多物理过程可存在多种有效演化路径,因此世界模型不仅需生成合理轨迹,还应复现相同初始条件下的行为分布。我们称此为分布级要求——概率对齐。然而现有评估多聚焦单个视频合理性,未检验重复生成是否恢复正确分布。这引出核心问题:当前视频生成器距离概率对齐的世界建模还有多远?为此,我们形式化概率对齐为世界模型的分布准则,并引入PAWBench基准,用于评估视频生成器作为世界动力学随机采样器的能力。我们进一步提出PAWEval,一种将多次视频推演转化为可能物理行为经验分布的结果级协议。在50个场景与11个当前系统中,无一模型能持续匹配参考概率,同时覆盖所有有效行为范围。确立该差距后,我们检验语言提示、初始噪声采样及模型训练能否重塑预测分布。我们认为本工作可为未来实现概率对齐世界建模奠定基础。

原文摘要 · Abstract (English)

Recent video generation models are increasingly framed as world models. Many physical processes can unfold in more than one valid way. Therefore, a world model should reproduce not only a plausible trajectory, but also the distribution of possible behaviors under the same initial observation and action. We call this distribution-level requirement probabilistic alignment. However, existing evaluations largely assess individual-video plausibility and do not test whether repeated generations recover the correct distribution. This raises a central question: how far are current video generators from probabilistically aligned world modeling? To answer it, we formalize probabilistic alignment as a distributional criterion for world models and introduce PAWBench, a benchmark for evaluating video generators as stochastic samplers of world dynamics. We further introduce PAWEval, an outcome-level protocol that converts repeated video rollouts into empirical distributions over possible physical behaviors. Across 50 scenarios and eleven current systems, no model consistently matches the reference probabilities while recovering the range of valid behaviors. Having established this gap, we test whether language prompts, initial noise sampling, or model training can reshape the model's predictive distribution. We believe our work can serve as a foundation for future efforts to move towards probabilistically aligned world modeling.

视频生成世界模型分布评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。