arXiv:2608.31029cs.CVcs.LG2026-08

用历史驾驶记忆替代摄像头输入,发现导航得分虚高

Driving on Memory

  • 用过往驾驶记忆替代实时视觉输入,测试模型表现
  • 在NAVSIM上表现接近甚至超越实时视觉模型
  • 提醒谨慎看待高分指标,仅适合特定测试场景

端到端自动驾驶模型从原始传感器输入中规划未来轨迹。早期基准多衡量与人类轨迹的偏差,而当前如NAVSIM和Bench2Drive等基准采用更丰富的仿真评估指标,旨在捕捉安全合规的驾驶行为。高分应反映模型对前方场景的理解与响应能力。但该分数中有多少真正来自对动态场景的反应?我们移除模型的摄像头输入,改用同一地点以往驾驶的记忆替代。这些记忆可提供道路布局、位置相关的规律性信息,但无法反映当前交通状态。令人意外的是,在NAVSIM上,仅靠记忆即可达到甚至超过领先端到端方法的表现。结果表明,高NAVSIM得分并不需要模型实时感知当前交通场景,需谨慎解读。此现象具有基准依赖性:在Bench2Drive和RealEngine上,仅靠记忆导致性能大幅下降。代码已开源。

原文摘要 · Abstract (English)

End-to-end autonomous driving models plan future trajectories from raw sensor input. While earlier driving benchmarks often measured deviation from the human trajectory, current benchmarks such as NAVSIM and Bench2Drive evaluate models with richer simulation-based metrics intended to capture safe and compliant driving. A high benchmark score should reflect that a model can understand the scene in front of it and act accordingly. But how much of that score specifically comes from reacting to the dynamic part of that scene? To probe this, we remove a model's camera input and replace it with memories from prior drives at the same location. The retrieved memories can provide persistent scene information, including road layout and location-conditioned regularities, but not the current traffic state. Surprisingly, memory is nearly sufficient on NAVSIM, reaching or even exceeding the performance of leading end-to-end methods without actually observing the evaluated scene. Our results suggest that a high NAVSIM score does not require a planner to react to the current traffic scene and should be treated with caution. This effect is benchmark-dependent: driving from memory causes substantially larger performance drops on Bench2Drive and RealEngine. We provide our code at https://github.com/boschresearch/MemoryDrivoR .

自动驾驶记忆机制基准测试仿真评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。