arXiv:2607.04179cs.CVcs.AI2026-07中稿 · ECCV被引 1

让自动驾驶模型自己学会思考,又快又准。

CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving

论文配图:CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving
图 1 · 摘自论文原文
  • 用多维度验证器引导强化学习,让模型内化逻辑推理能力。
  • 推理结果压缩成28个词的快速响应,延迟降低88%。
  • 适合追求高可靠性与低延迟的自动驾驶系统开发者。

端到端视觉语言模型在自动驾驶中潜力巨大,但标准监督微调常出现推理幻觉和保守偏差。传统工具增强框架与思维链方法虽能缓解问题,却导致高昂的令牌消耗和不可接受的延迟,难以实时部署。为此,我们提出CritiqueDriveVLM,一种统一的三阶段框架,将推理直接内化于视觉语言模型中。首先,引入由多维验证器指导的批判性多轮强化学习,通过细粒度标量反馈与多轮惩罚,迫使策略内化逻辑推导,培育出无需外部工具、高精度的系统2教师模型。随后,提出潜在思维蒸馏,通过对齐学生模型的潜在表示与教师模型完全收敛的推理状态,将深层逻辑能力压缩为无思维链的快速系统1学生模型。在广泛使用的DriveLMM-01基准上的实验证明,相比基础模型,我们的无工具教师模型将多项选择质量(MCQ)从55.54%提升至76.54%的顶尖水平。关键的是,蒸馏后的学生模型保持了有竞争力的推理深度,生成长度大幅缩减至平均仅28个词,推理延迟从3482毫秒降至416毫秒,降幅达88%,为低延迟自动驾驶提供了高度可靠的路径。代码已开源。

原文摘要 · Abstract (English)

End-to-end Vision-Language Models (VLMs) show immense potential in autonomous driving. However, standard Supervised Fine-Tuning (SFT) often suffers from reasoning hallucinations and conservative biases. While traditional tool-augmented frameworks and Chain-of-Thought (CoT) approaches mitigate these issues, they incur exorbitant token consumption and unacceptable latency, rendering real-time deployment impractical. To resolve this reliability-efficiency trade-off, we propose CritiqueDriveVLM, a novel unified three-stage framework internalizing reasoning directly into the VLM. First, we introduce Critique-Driven Multi-Turn Reinforcement Learning (RL) guided by a multi-dimensional verifier. By providing granular scalar feedback and a multi-turn penalty, we force the policy to internalize logical deduction, cultivating a robust System-2 Teacher that achieves high accuracy without fragile external tools. Subsequently, we propose Latent Thought Distillation to overcome the latency bottleneck. By aligning the Student's latent representations with the Teacher's fully converged reasoning states, we compress deep logical capabilities into a fast, CoT-free System-1 Student. Extensive experiments on the widely-used DriveLMM-01 benchmark demonstrate remarkable improvements. Compared to the base model, our tool-free Teacher significantly boosts Multiple Choice Quality (MCQ) from 55.54% to a state-of-the-art 76.54%. Crucially, our distilled Student preserves competitive reasoning depth while drastically minimizing generation length to an average of merely 28 tokens. This slashes inference latency by 88% (from 3482 ms to 416 ms), paving a highly robust pathway for low-latency autonomous driving.Our source code is available at https://github.com/MICLAB-BUPT/CritiqueDriveVLM.

自动驾驶视觉语言模型思维蒸馏强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。