arXiv:2510.16729cs.CV2025-10被引 4

用视觉预测动态变化,跳过静态背景建模。

Vision-Centric 4D Occupancy Forecasting and Planning via Implicit Residual World Models

  • 只预测场景变化部分,利用前一时刻特征作时间先验。
  • 在nuScenes上4D占用率预测与轨迹规划均达顶尖水平。
  • 适合需要高效动态感知的自动驾驶系统研究者。

端到端自动驾驶系统越来越多依赖视觉中心的世界模型来理解与预测环境。然而,这些模型普遍存在对未来的完整场景重建问题,耗费大量资源重复建模静态背景。为此,我们提出隐式残差世界模型(IR-WM),专注于建模当前状态及世界的演化过程。IR-WM首先从视觉观测中建立稳健的鸟瞰图表示;随后利用前一时刻的BEV特征作为强时间先验,仅预测“残差”——即基于自车动作和场景上下文的变化。为缓解误差累积,我们进一步引入对齐模块校正语义与动态错位。此外,我们研究了不同的预测-规划耦合方案,结果表明世界模型生成的隐式未来状态显著提升规划精度。在nuScenes基准上,IR-WM在4D占用率预测与轨迹规划方面均取得领先性能。

原文摘要 · Abstract (English)

End-to-end autonomous driving systems increasingly rely on vision-centric world models to understand and predict their environment. However, a common ineffectiveness in these models is the full reconstruction of future scenes, which expends significant capacity on redundantly modeling static backgrounds. To address this, we propose IR-WM, an Implicit Residual World Model that focuses on modeling the current state and evolution of the world. IR-WM first establishes a robust bird's-eye-view representation of the current state from the visual observation. It then leverages the BEV features from the previous timestep as a strong temporal prior and predicts only the "residual", i.e., the changes conditioned on the ego-vehicle's actions and scene context. To alleviate error accumulation over time, we further apply an alignment module to calibrate semantic and dynamic misalignments. Moreover, we investigate different forecasting-planning coupling schemes and demonstrate that the implicit future state generated by world models substantially improves planning accuracy. On the nuScenes benchmark, IR-WM achieves top performance in both 4D occupancy forecasting and trajectory planning.

自动驾驶世界模型4D占用率视觉预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。