arXiv:2512.20563cs.CVcs.AI2025-12中稿 · CVPR被引 26

解决模拟驾驶中专家与学习者之间的信息不对称问题,提升端到端自动驾驶性能。

LEAD: Minimizing Learner-Expert Asymmetry in End-to-End Driving

  • 通过缩小专家与学生在视野和不确定性上的差距,改进模仿学习效果。
  • 在CARLA基准上达到95分的DS,Longest6~v2性能翻倍,刷新多项纪录。
  • 适合研究自动驾驶模仿学习、仿真到现实迁移的开发者和研究人员。

模拟器可生成海量驾驶数据,但基于仿真的模仿学习策略仍难以实现稳健的闭环表现。我们实证研究发现,专家示范与传感器输入的学生观察之间存在显著不对称:专家拥有更高可见性(如忽略遮挡)和更低不确定性(如知晓其他车辆动作),导致难以被可靠模仿;同时,学生模型在测试时仅通过单一目标点定义导航意图,信息不足。我们证明这些不对称会显著限制驾驶性能,并提出针对性改进措施。经精心调整后,我们的TransFuser v6(TFv6)在所有主流公开CARLA闭环基准上达到新最佳,获得95分的DS成绩,在Longest6~v2和Town13上性能翻倍以上。此外,将数据集中的感知监督整合至共享的sim-to-real流程,也在NAVSIM和Waymo视觉端到端驾驶基准上实现持续提升。代码、数据与模型已开源。

原文摘要 · Abstract (English)

Simulators can generate virtually unlimited driving data, yet imitation learning policies in simulation still struggle to achieve robust closed-loop performance. Motivated by this gap, we empirically study how misalignment between privileged expert demonstrations and sensor-based student observations can limit the effectiveness of imitation learning. More precisely, experts have significantly higher visibility (e.g., ignoring occlusions) and far lower uncertainty (e.g., knowing other vehicles' actions), making them difficult to imitate reliably. Furthermore, navigational intent (i.e., the route to follow) is under-specified in student models at test time via only a single target point. We demonstrate that these asymmetries can measurably limit driving performance in CARLA and offer practical interventions to address them. After careful modifications to narrow the gaps between expert and student, our TransFuser v6 (TFv6) student policy achieves a new state of the art on all major publicly available CARLA closed-loop benchmarks, reaching 95 DS on Bench2Drive and more than doubling prior performances on Longest6~v2 and Town13. Additionally, by integrating perception supervision from our dataset into a shared sim-to-real pipeline, we show consistent gains on the NAVSIM and Waymo Vision-Based End-to-End driving benchmarks. Our code, data, and models are publicly available at https://github.com/autonomousvision/lead.

自动驾驶模仿学习仿真迁移端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。