arXiv:2605.11550cs.CV2026-05被引 2

让世界预测与动作生成互相迭代,提升自动驾驶规划能力。

The DAWN of World-Action Interactive Models

论文配图:The DAWN of World-Action Interactive Models
图 1 · 摘自论文原文
  • 世界预测与动作去噪在潜空间中循环互馈,实现双向优化
  • 在多个驾驶基准上表现优异,长时轨迹生成更安全可靠
  • 适合需要动态交互推理的自动驾驶系统研究者

可信的场景演化依赖于所考虑的行驶策略,而良好的策略又取决于场景可能的演化。现有世界动作模型(WAMs)大多忽略了这种相互作用,将世界预测与动作生成视为独立或固定顺序的流程。本文提出世界-动作交互模型(WAIMs),并以DAWN(Denoising Actions and World Interactive model)为例进行实现。DAWN在紧凑的语义潜空间中运行,结合了世界预测器与世界条件动作去噪器:预测的世界假设用于指导动作去噪,而去噪后的动作假设又反馈更新世界预测,使两者在推理过程中递归优化。相比完全消除测试时世界演化或在像素空间完整滚动未来,DAWN仅进行短程显式潜空间滚动,即可支持复杂交互场景中的长时轨迹生成。实验表明,DAWN在多个自动驾驶基准上均取得优异的规划性能和安全相关指标。结果表明,交互式世界-动作生成是迈向真正可行动世界模型的合理路径。

原文摘要 · Abstract (English)

A plausible scene evolution depends on the maneuver being considered, while a good maneuver depends on how the scene may evolve. Existing World Action Models (WAMs) largely miss this reciprocity, treating world prediction and action generation as either isolated parallel branches or rigid predict-then-plan pipelines. We formalize this perspective as World-Action Interactive Models (WAIMs), and instantiate it in autonomous driving with \textbf{DAWN} (\textbf{D}enoising \textbf{A}ctions and \textbf{W}orld i\textbf{N}teractive model), a simple yet strong latent generative baseline. DAWN operates in a compact semantic latent space and couples a \emph{World Predictor} with a \emph{World-Conditioned Action Denoiser}: the predicted world hypothesis conditions action denoising, while the denoised action hypothesis is fed back to update the world prediction, so that both are recursively refined during inference. Rather than eliminating test-time world evolution altogether or rolling out the full future in pixel space, DAWN performs a short explicit latent rollout that is sufficient to support long-horizon trajectory generation in complex interactive scenes. Experiments show that DAWN achieves strong planning performance and favorable safety-related results across multiple autonomous driving benchmarks. More broadly, our results suggest that interactive world-action generation is a principled path toward truly actionable world models.

自动驾驶交互建模生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。