arXiv:2506.24113cs.CV2025-06ICCV被引 125

Epona让自动驾驶模型能长时间、高精度预测未来场景并自动规划路径。

Epona: Autoregressive Diffusion World Model for Autonomous Driving

论文配图:Epona: Autoregressive Diffusion World Model for Autonomous Driving
图 1 · 摘自论文原文
  • 分步生成时空分布,避免全局建模的局限性。
  • 预测时长更久,视频质量提升7.4% FVD得分。
  • 端到端融合轨迹规划与视觉生成,适合自动驾驶系统研发。

扩散模型在视频生成中展现出卓越的视觉质量,为自动驾驶世界建模提供了新可能。然而,现有基于视频扩散的世界模型在灵活长度、长时程预测及轨迹规划集成方面表现不佳,因其依赖固定长度帧序列的全局联合分布建模,而非逐时步构建局部分布。本文提出Epona,一种自回归扩散世界模型,通过两项关键创新实现局部时空分布建模:1)解耦时空因子分解,将时序动态建模与精细未来场景生成分离;2)模块化轨迹与视频预测,在端到端框架中无缝融合运动规划与视觉建模。该架构支持高分辨率、长时间生成,并引入新型链式前向训练策略,缓解自回归循环中的误差累积问题。实验表明,相比以往方法,其性能达到顶尖水平,FVD提升7.4%,预测时长延长数分钟。所学世界模型还可作为实时运动规划器,在NAVSIM基准上超越强基线端到端规划器。代码将公开于 https://github.com/Kevin-thu/Epona/。

原文摘要 · Abstract (English)

Diffusion models have demonstrated exceptional visual quality in video generation, making them promising for autonomous driving world modeling. However, existing video diffusion-based world models struggle with flexible-length, long-horizon predictions and integrating trajectory planning. This is because conventional video diffusion models rely on global joint distribution modeling of fixed-length frame sequences rather than sequentially constructing localized distributions at each timestep. In this work, we propose Epona, an autoregressive diffusion world model that enables localized spatiotemporal distribution modeling through two key innovations: 1) Decoupled spatiotemporal factorization that separates temporal dynamics modeling from fine-grained future world generation, and 2) Modular trajectory and video prediction that seamlessly integrate motion planning with visual modeling in an end-to-end framework. Our architecture enables high-resolution, long-duration generation while introducing a novel chain-of-forward training strategy to address error accumulation in autoregressive loops. Experimental results demonstrate state-of-the-art performance with 7.4\% FVD improvement and minutes longer prediction duration compared to prior works. The learned world model further serves as a real-time motion planner, outperforming strong end-to-end planners on NAVSIM benchmarks. Code will be publicly available at \href{https://github.com/Kevin-thu/Epona/}{https://github.com/Kevin-thu/Epona/}.

自动驾驶扩散模型世界模型轨迹规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。