用真实轨迹数据直接监督中间特征,提升端到端自动驾驶规划性能。
PRISM: Privileged Probabilistic Latent Supervision for End-to-End Autonomous Driving Motion Planning

- 将真实轨迹作为概率分布,通过变分推断优化中间特征
- 在nuScenes上规划误差降低8%,碰撞率减少3%
- 适合追求高精度规划且关注模型内部机制的开发者
端到端自动驾驶系统将感知、预测与规划整合为单一可微架构。尽管此类模型前景广阔,但其标准训练依赖输出层监督,导致深层隐藏层梯度弱化。近期工作引入视觉语言模型(VLM)对隐含特征进行监督,取得显著效果,但理论机制尚不明确。我们研究发现,性能提升并非源于VLM推理能力,而是模型与真实数据在训练中建立的隐层关联。基于此,我们提出一种概率化深度监督框架,直接从真实数据(GT)对中间隐状态进行正则化。通过将模型隐变量视为可重参数化的分布,利用证据下界(ELBO)优化网络结构。在nuScenes数据集上的评估表明,对轨迹相关隐层使用未来真实路径监督,能持续提升规划性能。在相同训练数据与模型架构下,相比主流向量基基线,本方法实现规划L2误差降低8%、碰撞率下降3%,计算开销几乎忽略不计。
原文摘要 · Abstract (English)
End-to-end autonomous driving (E2E AD) systems integrate perception, prediction, and planning into a single differentiable architecture. While these models show great promise, their standard training often relies on output-only supervision, which can lead to weak gradients for the hidden layers of increasingly complex models. Recent works have integrated vision-language model (VLM) supervision for latent features to address this, yielding substantial empirical gains, yet leaving the underlying theoretical mechanisms poorly understood. Our investigation into this methodology reveals that the resulting performance gains stem not from VLM reasoning capabilities, as previously assumed, but rather from the latent connections forged between the E2E AD model and ground-truth (GT) data during training. Building on this insight, we propose a probabilistic deep supervision framework that regularizes intermediate latent representations directly from GT data. By treating model latents as reparameterizable distributions, we optimize the architecture via the Evidence Lower Bound (ELBO). Our evaluations conducted on the nuScenes dataset demonstrate that supervising trajectory-related latents with future GT paths consistently improves planning performance. Using identical training data and E2E architectures, our method achieves an 8% reduction in planning L2 error and a 3% decrease in collision rates compared to competitive vectorized baselines, all while incurring negligible computational overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。