arXiv:2606.07338cs.CV2026-06

用可验证的反事实监督,让视觉语言驾驶模型更省成本、更靠谱。

VeriDrive: Verifiable Counterfactual Supervision for Cost-Efficient Vision-Language Planning

论文配图:VeriDrive: Verifiable Counterfactual Supervision for Cost-Efficient Vision-Language Planning
图 1 · 摘自论文原文
  • 把驾驶推理拆成感知-评估-修正链,每步都有可检查证据
  • 在nuScenes上训练,比OmniDrive降低30%以上调用成本
  • 适合想低成本提升自动驾驶规划能力的研究者

视觉语言驾驶模型日益依赖推理监督来连接感知、预测与规划,但现有驾驶理由多为自由文本,生成成本高昂。本文提出VeriDrive框架,构建面向规划的可验证反事实监督。该框架将驾驶推理转化为结构化的感知-评估-修正链:定位未来运动中的关键物体,用规则可查的证据评估替代自车轨迹,修正高风险意图以贴近专家行为,并生成最终规划目标。为实现数据规模化,VeriDrive结合局部生成与验证器引导的选择性修正,仅对无效或困难样本进行升级。我们在nuScenes数据集上构建了VeriDrive数据集,并在Omni-Q协议下进行训练。控制性开环实验表明,VeriDrive在保持更低日志令牌使用量、生成时间和实际支付的大模型/视觉语言模型成本的同时,提升了L2误差、碰撞率和交叉路口表现,优于OmniDrive。结果表明,在真实标注预算下,可审计的中间字段与结构化修正目标能有效提升视觉语言规划的监督质量。

原文摘要 · Abstract (English)

Vision-language driving models increasingly use reasoning supervision to bridge perception, prediction, and planning, but existing driving rationales are often free-form and expensive to generate with frontier models. We present VeriDrive, a framework for constructing planning-oriented, verifiable counterfactual supervision. VeriDrive converts driving reasoning into a structured Perception-Evaluation-Revision chain that grounds key objects in future motion, evaluates alternative ego trajectories with rule-checkable evidence, revises risky intent toward expert behavior, and produces final planning targets. To scale data construction, VeriDrive combines local generation with validator-guided selective correction, escalating only invalid or difficult samples. We build the VeriDrive dataset on nuScenes and train under the Omni-Q protocol. Controlled open-loop experiments show that VeriDrive improves L2, Collision, and Intersection over OmniDrive while reducing logged token usage, generation time, and actual paid LLM/VLM cost. These results show that auditable intermediate fields and structured revision targets can improve vision-language planning supervision under realistic annotation budgets. Code, prompts, and validator scripts are coming soon and will be released after the review process.

自动驾驶视觉语言反事实低成本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。