arXiv:2607.19194cs.ROcs.CV2026-07

用双路径机制让自动驾驶规划更智能、更可靠。

Cognitive Dual-Process Planning for Autonomous Driving with Structured Scene Knowledge and Verifiable Reasoning-Action Consistency

论文配图:Cognitive Dual-Process Planning for Autonomous Driving with Structured Scene Knowledge and Verifiable Reasoning-Action Consistency
图 1 · 摘自论文原文
  • 分快慢两条路径:简单场景直接决策,复杂场景才深度推理。
  • 自动生成结构化推理数据,准确率达91.8%,逻辑一致性达98.5%。
  • 通过规则验证确保推理与动作一致,适合高安全要求的自动驾驶系统。

自动驾驶高层规划是依赖知识的工程决策任务,需精准理解环境、及时推断并保持行为一致性。视觉语言模型(VLM)可显式生成推理过程,但部署受限于昂贵的结构化标注、常规场景中的冗余推理及推理与动作间的不一致。本文提出认知双路径规划框架,将场景知识以机器可读的结构化思维链(S-CoT)形式表示。自动化数据引擎结合感知基础模型、关键路径筛选和专家VLM,无需人工标注即可生成S-CoT监督信号。轻量级视觉仲裁器基于多层视觉编码特征评估场景复杂度,在语言解码前决定输入应走快速元动作预测或慢速结构化推理路径。对慢路径输出,基于规则的验证器检查解析后的S-CoT字段是否与最终元动作一致,并为组相对策略优化(GRPO)提供可验证奖励。在195个场景的人工审计中,生成标注的思维链准确率达91.8%,逻辑一致性得分(LCS)为98.5%。在574个手动验证的NAVSIM测试样本上,规划准确率达80.14%,LCS为97.20%,平均延迟降低17.39%。外部长尾子集评估进一步揭示了路由与规划性能下降的条件。结果表明,通过自适应推理与规则验证,可有效实现显式场景知识在高层VLM规划中的落地。

原文摘要 · Abstract (English)

High-level planning for autonomous driving is a knowledge-intensive engineering decision task that requires accurate scene understanding, timely inference, and internally consistent action selection. Vision-language models (VLMs) can make intermediate reasoning explicit, but their use in deployed planners is constrained by costly structured supervision, unnecessary reasoning in routine scenes, and possible inconsistencies between generated rationales and driving actions. We present a cognitive dual-process planning framework that represents planning-relevant scene knowledge in a machine-parsable structured chain-of-thought (S-CoT) schema. An automated data engine integrates perception foundation models, critical-path filtering, and an expert VLM to generate S-CoT supervision without manual annotation of individual rationales. A lightweight visual Arbiter estimates scene complexity from multilevel vision-encoder features before language decoding and routes each input to either fast meta-action prediction or slow structured reasoning. For slow-path outputs, a deterministic rule-based validator checks whether the parsed S-CoT fields are consistent with the final meta-action and provides verifiable rewards for Group Relative Policy Optimization (GRPO). In a 195-scene manual audit, the generated annotations achieve 91.8\% CoT accuracy and a 98.5\% Logical Consistency Score (LCS). On 574 manually verified NAVSIM test samples, the planner achieves 80.14\% planning accuracy and 97.20\% LCS while reducing average latency by 17.39\% relative to applying slow reasoning to every scene. Evaluation on external long-tail subsets further identifies conditions under which routing and planning performance degrade. Together, these results show how explicit scene knowledge can be operationalized through adaptive reasoning and rule-based verification to support high-level VLM planning decisions.

自动驾驶双路径可验证推理结构化思维链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。