让自动驾驶模型具备持续思考能力,减少决策抖动。
CogDriver: Integrating Cognitive Inertia for Temporally Coherent Planning in Autonomous Driving
- 引入稀疏时序记忆与知识蒸馏,构建稳定内部状态。
- 在Bench2Drive上驾驶得分提升22%,nuScenes轨迹误差降低21%。
- 适合关注长期决策与驾驶连贯性的自动驾驶研究者。
当前视觉-语言模型在自主驾驶中因缺乏认知惯性,仅基于孤立图像帧进行决策,导致行为不稳定、多步操作失败。为此,本文提出CogDriver框架:首先构建大规模视觉-语言-动作数据集CogDriver-Data,其叙事标注提供学习时序动态与持续意图的监督信号;其次设计CogDriver-Agent架构,采用稀疏时序记忆与时空知识蒸馏机制,显式强化决策连贯性。大量实验验证该范式有效性:在Bench2Drive上闭环驾驶得分提升22%,在nuScenes上均方误差降低21%,达到新基准水平。这些结果表明模型成功维持了时序连贯的内部状态,推动了更可靠的自动驾驶发展。
原文摘要 · Abstract (English)
The pursuit of autonomous agents capable of temporally coherent planning is hindered by a fundamental flaw in current vision-language models (VLMs): they lack cognitive inertia. Operating on isolated snapshots, these models cannot form a continuous understanding of the environment, leading to erratic decision jitter and a failure to execute complex, multi-step maneuvers. To remedy this, we introduce CogDriver, a framework designed to build a stable internal representation by instilling this crucial cognitive property. Our work makes two key contributions: (1) We present CogDriver-Data, a large-scale vision-language-action dataset whose narrative annotations provide the supervisory signal for learning temporal dynamics and persistent intent. (2) We develop the CogDriver-Agent, an architecture featuring a sparse temporal memory to maintain a stable internal state. This is enabled by a spatiotemporal knowledge distillation approach that explicitly teaches decision coherence. Comprehensive experiments validate our paradigm: CogDriver-Agent achieves a 22% increase in the closed-loop Driving Score on Bench2Drive and a 21% reduction in mean L2 error on nuScenes, establishing a new state-of-the-art. These significant gains in both long-term decision-making and imitation accuracy provide strong evidence that our agent successfully maintains a temporally coherent internal state, bridging the gap toward more reliable autonomous driving. Project link: https://ocean-luna.github.io/CogDriver.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。