arXiv:2510.11092cs.CV2025-10NeurIPS被引 24

让自动驾驶同时预测路况和自身轨迹,双向优化更聪明决策。

Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution

  • 双向建模:预测未来场景并反向影响路径规划
  • 在nuScenes和NAVSIM上超越现有方法,显著提升决策能力
  • 适合研究端到端自动驾驶与动态环境交互的学者

端到端自动驾驶方法旨在将原始传感器输入直接映射为未来驾驶动作(如规划轨迹),跳过传统模块化流程。尽管这类方法已展现潜力,但常采用一次性推理范式,过度依赖当前场景上下文,低估了场景动态及其时间演化的价值,限制了复杂场景下的适应性决策能力。本文提出新视角:自动驾驶车辆的未来轨迹与周围环境的动态演化相互关联,且彼此影响。为此,我们提出SeerDrive框架,以闭环方式联合建模未来场景演化与轨迹规划。该方法首先预测未来鸟瞰图(BEV)表示以预判周边动态,再利用此前瞻性信息生成未来上下文感知的轨迹。两个关键组件支撑此机制:(1) 未来感知规划,将预测的BEV特征注入轨迹规划器;(2) 迭代式场景建模与车辆规划,通过协同优化持续改进未来场景预测与轨迹生成。在NAVSIM和nuScenes基准上的大量实验表明,SeerDrive显著优于现有最先进方法。

原文摘要 · Abstract (English)

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under a one-shot paradigm that relies heavily on the current scene context, potentially underestimating the importance of scene dynamics and their temporal evolution. This limitation restricts the model's ability to make informed and adaptive decisions in complex driving scenarios. We propose a new perspective: the future trajectory of an autonomous vehicle is closely intertwined with the evolving dynamics of its environment, and conversely, the vehicle's own future states can influence how the surrounding scene unfolds. Motivated by this bidirectional relationship, we introduce SeerDrive, a novel end-to-end framework that jointly models future scene evolution and trajectory planning in a closed-loop manner. Our method first predicts future bird's-eye view (BEV) representations to anticipate the dynamics of the surrounding scene, then leverages this foresight to generate future-context-aware trajectories. Two key components enable this: (1) future-aware planning, which injects predicted BEV features into the trajectory planner, and (2) iterative scene modeling and vehicle planning, which refines both future scene prediction and trajectory generation through collaborative optimization. Extensive experiments on the NAVSIM and nuScenes benchmarks show that SeerDrive significantly outperforms existing state-of-the-art methods.

端到端驾驶轨迹规划场景预测双向建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。