让自动驾驶模型在训练后继续优化,提升安全与可靠性。
Post-Training in End-to-End Autonomous Driving

- 用事后训练技术改进端到端驾驶策略,超越单纯模仿专家
- 解决执行误差累积和恢复行为缺失问题,提升长时驾驶表现
- 适合关注自动驾驶安全与鲁棒性的研究者和开发者
端到端模型将多模态输入直接映射为未来轨迹或驾驶动作,已成为自动驾驶的主流研究范式,涵盖视觉-语言-动作模型和轨迹生成规划器。与传统机器学习应用不同,自动驾驶面对高安全要求且交互复杂的环境,单纯开环模仿专家示范不足以保证可靠性。小的执行误差会随时间累积,而训练数据中缺乏恢复行为,长时目标如安全性和舒适性也无法通过逐点标签捕捉。这些限制促使研究转向事后训练技术,以在纯模仿基础上进一步优化驾驶策略。本文从监督形式出发,将现有文献归纳为四类主要方法,系统分析其能力、局限与开放挑战,旨在推动对这一新兴领域的理解,并激发更可靠、高效的自动驾驶事后训练研究。相关论文集合见:https://github.com/RYNing/Awesome-Post-Training-In-Autonomous-Driving-Papers。
原文摘要 · Abstract (English)
End-to-end models that map multimodal inputs directly to future trajectories/maneuvers have emerged as an increasingly prominent research paradigm in autonomous driving. This class of models includes both Vision-Language-Action models and trajectory-generative planners. Unlike classic machine learning applications, autonomous vehicles operate in safety-critical and interaction-intensive environments where traditional open-loop imitation of expert demonstrations is not sufficient to ensure reliability. In particular, small execution errors can accumulate over time, while recovery behaviors are scarce in training data. In addition, long-horizon objectives such as safety and driving comfort are not captured by pointwise labels either. These limitations have motivated a shift toward post-training techniques, which further refine driving policies beyond pure imitation. This survey presents a unified view of post-training for autonomous driving by defining its scope and organizing the existing literature into four major families based on the form of supervision they use. For each family, we discuss its capabilities, limitations, and open challenges. We aim to facilitate a systematic understanding of this emerging area and stimulate future research on reliable and efficient post-training for autonomous driving.A collection of related papers is available at https://github.com/RYNing/Awesome-Post-Training-In-Autonomous-Driving-Papers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。