通过时序残差建模动态物体,提升端到端自动驾驶规划精度。
ResWorld: Temporal Residual World Model for End-to-End Autonomous Driving
- 基于时序残差提取动态物体信息,无需检测与跟踪。
- 在nuScenes和NAVSIM上实现当前最优规划性能。
- 适合关注动态场景建模与轨迹优化的自动驾驶研究者。
世界模型对驾驶场景的全面理解显著提升了端到端自动驾驶框架的规划准确性。然而,静态区域的冗余建模以及与轨迹的深层交互不足,限制了世界模型的潜力。本文提出时序残差世界模型(TR-World),聚焦于动态物体建模。通过计算场景表征的时序残差,可在不依赖检测与跟踪的情况下提取动态物体信息。TR-World仅以时序残差为输入,更精准预测动态物体未来的空间分布。结合当前BEV特征中的静态物体信息,可获得准确的未来BEV特征。此外,我们提出未来引导轨迹精修模块(FGTR),实现先验轨迹(由当前场景表征预测)与未来BEV特征之间的交互。该模块不仅能利用未来道路状况精修轨迹,还为未来BEV特征提供稀疏时空监督,防止世界模型坍缩。在nuScenes和NAVSIM数据集上的综合实验表明,所提方法ResWorld达到当前最优规划性能。代码已开源:https://github.com/mengtan00/ResWorld.git。
原文摘要 · Abstract (English)
The comprehensive understanding capabilities of world models for driving scenarios have significantly improved the planning accuracy of end-to-end autonomous driving frameworks. However, the redundant modeling of static regions and the lack of deep interaction with trajectories hinder world models from exerting their full effectiveness. In this paper, we propose Temporal Residual World Model (TR-World), which focuses on dynamic object modeling. By calculating the temporal residuals of scene representations, the information of dynamic objects can be extracted without relying on detection and tracking. TR-World takes only temporal residuals as input, thus predicting the future spatial distribution of dynamic objects more precisely. By combining the prediction with the static object information contained in the current BEV features, accurate future BEV features can be obtained. Furthermore, we propose Future-Guided Trajectory Refinement (FGTR) module, which conducts interaction between prior trajectories (predicted from the current scene representation) and the future BEV features. This module can not only utilize future road conditions to refine trajectories, but also provides sparse spatial-temporal supervision on future BEV features to prevent world model collapse. Comprehensive experiments conducted on the nuScenes and NAVSIM datasets demonstrate that our method, namely ResWorld, achieves state-of-the-art planning performance. The code is available at https://github.com/mengtan00/ResWorld.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。