arXiv:2512.14044cs.CVcs.AI2025-12被引 9

用强化学习让视觉语言模型自动聚焦关键区域,提升自动驾驶推理可靠性。

OmniDrive-R1: Reinforcement-driven Interleaved Multi-modal Chain-of-Thought for Trustworthy Vision-Language Autonomous Driving

  • 通过交替融合多模态思维链,实现感知与推理端到端联合优化。
  • 在DriveLMM-o1上推理得分从51.77%升至80.35%,答案准确率从37.81%提至73.62%。
  • 无需密集标注,靠实时跨模态一致性奖励增强视觉定位能力,适合高安全场景研究者。

视觉语言模型(VLM)在自动驾驶等高安全领域部署受制于可靠性问题,尤其是物体幻觉。这源于其依赖无实体支撑的文本思维链(CoT)。现有方法虽尝试多模态缓解,但存在两方面缺陷:(1)感知与推理阶段分离,无法端到端联合优化;(2)依赖昂贵且密集的定位标注。为此,我们提出OmniDrive-R1,一种面向自动驾驶的端到端VLM框架,通过交错式多模态思维链(iMCoT)统一感知与推理。核心创新是强化驱动的视觉定位能力,使模型可自主引导注意力并“聚焦”关键区域进行细粒度分析。该能力由纯两阶段强化学习训练流程及Clip-GRPO算法实现。关键在于,Clip-GRPO引入无标注、基于过程的定位奖励,既消除密集标注需求,又通过强制视觉焦点与文本推理的实时跨模态一致性,规避外部工具调用带来的不稳定性。在DriveLMM-o1上的大量实验表明,相比基线Qwen2.5VL-7B,OmniDrive-R1将整体推理得分从51.77%提升至80.35%,最终答案准确率从37.81%提升至73.62%。

原文摘要 · Abstract (English)

The deployment of Vision-Language Models (VLMs) in safety-critical domains like autonomous driving (AD) is critically hindered by reliability failures, most notably object hallucination. This failure stems from their reliance on ungrounded, text-based Chain-of-Thought (CoT) reasoning. While existing multi-modal CoT approaches attempt mitigation, they suffer from two fundamental flaws: (1) decoupled perception and reasoning stages that prevent end-to-end joint optimization, and (2) reliance on expensive, dense localization labels. Thus we introduce OmniDrive-R1, an end-to-end VLM framework designed for autonomous driving, which unifies perception and reasoning through an interleaved Multi-modal Chain-of-Thought (iMCoT) mechanism. Our core innovation is an Reinforcement-driven visual grounding capability, enabling the model to autonomously direct its attention and "zoom in" on critical regions for fine-grained analysis. This capability is enabled by our pure two-stage reinforcement learning training pipeline and Clip-GRPO algorithm. Crucially, Clip-GRPO introduces an annotation-free, process-based grounding reward. This reward not only eliminates the need for dense labels but also circumvents the instability of external tool calls by enforcing real-time cross-modal consistency between the visual focus and the textual reasoning. Extensive experiments on DriveLMM-o1 demonstrate our model's significant improvements. Compared to the baseline Qwen2.5VL-7B, OmniDrive-R1 improves the overall reasoning score from 51.77% to 80.35%, and the final answer accuracy from 37.81% to 73.62%.

自动驾驶多模态强化学习视觉定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。