arXiv:2605.24354cs.CV2026-05

用稀疏场景表示降低计算开销,提升自动驾驶规划安全性和效率

SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation

论文配图:SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation
图 1 · 摘自论文原文
  • 通过稀疏表征只预测关键场景元素,减少冗余计算
  • 在nuScenes上碰撞率低至0.05%,开环规划达顶尖水平
  • 适合追求高效、安全的端到端自动驾驶系统研究者

世界模型在提升端到端自动驾驶系统方面取得进展,但现有方法依赖密集场景表示,导致计算成本高且信息冗余。本文提出SparseWorld,一种轻量级世界模型,专注于预测场景的关键布局,实现高效的未来预测。该模型首先进行自回归滚动,预测未来地图元素与周围智能体;随后利用预测结果优化下游运动预测与轨迹规划。我们提出Sparse Dreamer,通过时空联合注意力机制在潜在空间中预测未来实例。通过与预测未来交互,运动规划器捕捉更准确的运动模式,生成更安全、更合理的轨迹。大量实验表明,SparseWorld显著降低碰撞风险,在nuScenes数据集开环规划指标上达到0.05%碰撞率,性能处于领先;在Bench2Drive闭环规划任务中也大幅超越基线方法。

原文摘要 · Abstract (English)

Recently, world models have made significant progress in enhancing end-to-end driving systems through both future situation forecasting and improved scene understanding. However, existing driving world models are typically built upon dense scene representations, causing high computational costs and redundant information. In this paper, we present SparseWorld, a lightweight world model that focuses on predicting only the critical layout of the scene, enabling efficient future forecasting for end-to-end driving systems. SparseWorld first performs autoregressive rollout to forecast future map elements and surrounding agents, enabling the model to learn how driving scenarios evolve over time. It then leverages these predicted futures to refine downstream motion prediction and trajectory planning. Specifically, we propose a Sparse Dreamer that anticipates future instances in the latent space through joint temporal and spatial attention. By interacting with predicted future instances, the motion planner captures more accurate motion patterns and generates more informed and safety-aware trajectories. Extensive experiments demonstrate that SparseWorld significantly reduces collision risk and achieves state-of-the-art performance on the open-loop planning metrics of the nuScenes dataset with a collision rate of 0.05\%. Moreover, it substantially outperforms the baseline method in closed-loop planning metrics on the Bench2Drive benchmark. Supplementary material is available at the project page: https://wryzju.github.io/SparseWorld/.

自动驾驶世界模型稀疏表示轨迹规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。