arXiv:2602.06214cs.CVcs.AI2026-02

用可微车辆模型让动作型自动驾驶系统在路点基准下训练评估

Addressing the Waypoint-Action Gap in End-to-End Autonomous Driving via Vehicle Motion Models

  • 构建可微车辆模型,将动作序列转化为路点轨迹进行监督
  • 在NAV SIM navhard上达到当前最佳性能,显著优于基线
  • 首次实现动作型模型在路点基准下的公平训练与评估

端到端自动驾驶系统通常分为路点输出型和动作输出型。当前主流评测协议与训练流程均为路点型,导致动作型策略难以训练和比较,制约其发展。为此,本文提出一种新型可微车辆模型框架,将预测的动作序列滚动生成对应的自车坐标系路点轨迹,并在路点空间进行监督。该方法使动作型架构首次能在不修改原有评测协议的前提下,参与路点型基准的训练与评估。我们在多个挑战性基准上进行了广泛验证,结果一致优于基线模型。尤其在NAV SIM navhard上取得了当前最优表现。代码将在论文录用后公开。

原文摘要 · Abstract (English)

End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake. Most recent benchmark protocols and training pipelines are waypoint-based, which makes action-based policies harder to train and compare, slowing their progress. To bridge this waypoint-action gap, we propose a novel, differentiable vehicle-model framework that rolls out predicted action sequences to their corresponding ego-frame waypoint trajectories while supervising in waypoint space. Our approach enables action-based architectures to be trained and evaluated, for the first time, within waypoint-based benchmarks without modifying the underlying evaluation protocol. We extensively evaluate our framework across multiple challenging benchmarks and observe consistent improvements over the baselines. In particular, on NAVSIM \texttt{navhard} our approach achieves state-of-the-art performance. Our code will be made publicly available upon acceptance.

自动驾驶端到端动作预测可微模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。