arXiv:2606.31830cs.CVcs.RO2026-06中稿 · ECCV被引 1

给自动驾驶加'记忆地图',让车辆提前预判路况。

PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving

论文配图:PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving
图 1 · 摘自论文原文
  • 用道路级视觉先验构建行车路线的上下文记忆
  • 在NAVSIM-v2上提升多种端到端模型性能
  • 抗传感器故障,记忆失效时仍有安全退路

多数端到端自动驾驶方法仅依赖即时传感器输入,导致行为被动,缺乏人类驾驶员基于经验的前瞻能力。本文提出地理空间视觉先验,即与预期行驶路径绑定的街景上下文信息,实现独立于实时传感器的视觉-空间前瞻性。我们设计了一种内存增强模块,采用双记忆架构和自适应记忆门控机制,可无缝集成至现有端到端框架。该结构包含用于检索先验的上下文记忆与持久化备用记忆,动态调节记忆影响以匹配当前状态。在 NAVSIM-v2 基准测试中,该方法持续提升多种端到端基线模型表现。由于先验不依赖车载传感器,本方法天然具备对传感器损坏的鲁棒性;双记忆设计还能在检索先验失效时提供安全保障。

原文摘要 · Abstract (English)

Most end-to-end autonomous driving methods rely solely on instantaneous sensor observations, limiting them to reactive behavior without the anticipatory foresight human drivers employ through prior experience. We introduce geospatial visual priors, street-level visual context anchored to the intended driving route, providing visual-spatial foresight independent of real-time sensors. We propose a memory augmentation module featuring a dual-memory architecture and an adaptive memory gate, which can be easily integrated into existing end-to-end approaches. This design pairs a contextual memory for retrieved priors with a persistent fallback memory, and dynamically regulates the influence of memories based on current state compatibility. Evaluated on the NAVSIM-v2 benchmark, our approach consistently improves performance across diverse end-to-end baselines. Furthermore, because these priors are independent of onboard sensors, our method inherently improves robustness against sensor corruption, while the dual-memory design ensures safe fallback when the retrieved priors themselves become unreliable. Our project page is available at https://ori-mrg.github.io/PriorEye.

自动驾驶视觉先验记忆模块

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。