arXiv:2606.17539cs.CVcs.AI2026-06

让视觉语言模型同时具备逻辑推理和三维定位能力,提升空间理解效果。

Reinforcing Dual-Path Reasoning in Spatial Vision Language Models

论文配图:Reinforcing Dual-Path Reasoning in Spatial Vision Language Models
图 1 · 摘自论文原文
  • 设计双路径推理框架:语言链式推理与检测后推理并行
  • 在多个空间基准上超越基线,支持精准3D定位与泛化推理
  • 适合需要多步空间分析的自动驾驶、机器人场景

空间视觉语言模型在几何感知方面已取得显著进展,但涉及深度、距离和场景关系的多步推理仍具挑战。不同空间问题需不同策略:部分适合纯语言逐步推演,另一些则需先进行3D定位再做量化推理。本文提出基于强化学习的空间双路径推理框架(SR-REAL),使模型具备两种互补路径:仅语言推理(LOR)进行逐步语言推演,检测后推理(DTR)通过区域标记检测3D几何线索(如中心点或边界框)再执行显式几何推理。该框架先通过冷启动监督微调构建链式思维监督并暴露区域到3D接口,再通过强化学习优化策略模型,以准确性和格式奖励为目标;对DTR引入基于离散中心的检测奖励,进一步提升几何对齐精度。在多个空间基准测试中,单个经过强化学习训练的模型同时支持两路径,其中DTR在依赖区域的任务中实现精确3D定位,而LOR增强通用空间推理能力;联合训练促进双向增强;高质量混合冷启动数据对稳定强化学习至关重要;模型在跨数据集与领域间无需任务调优即可泛化,表明LOR与DTR之间存在正向迁移。

原文摘要 · Abstract (English)

Spatial VLMs have made substantial progress in geometric perception, yet complex spatial reasoning requiring multi-step inference over depth, distance, and scene relations remains challenging. Moreover, different spatial queries call for fundamentally different strategies: some are best addressed through purely linguistic, step-by-step deduction, while others require explicit 3D grounding before quantitative inference. We present Dual-Path Spatial Reasoning via Reinforcement Learning for Spatial VLMs (SR-REAL), a unified framework that equips a spatial VLM with two complementary reasoning paths: Language-Only Reasoning (LOR), which performs step-by-step linguistic deduction, and Detect-Then-Reason (DTR), which detects 3D geometric cues (e.g., centers or bounding boxes) via region tokens before explicit geometric inference. SR-REAL begins with a cold-start supervised fine-tuning stage that constructs LOR and DTR chain-of-thought supervision and exposes a region-to-3D interface, followed by RL that optimizes the policy model with accuracy and format rewards; for DTR, a discrete center-based detection reward further refines geometric alignment. Across diverse spatial benchmarks, SR-REAL significantly outperforms spatial VLM baselines: (i) a single RL-trained model supports both reasoning paths, with DTR excelling in region-aware tasks through precise 3D localization and LOR enhancing general spatial reasoning; (ii) jointly training both paths fosters mutual reinforcement; (iii) high-quality, blended cold-start data is crucial for stable RL optimization; and (iv) the model generalizes across datasets and domains without per-task tuning, demonstrating positive transfer between LOR and DTR.

空间推理双路径强化学习视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。