arXiv:2608.10278cs.CV2026-08

给视觉语言模型加空间思维,不改结构也能精准感知物体大小和房间尺寸。

Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models

论文配图:Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
图 1 · 摘自论文原文
  • 用连续空间令牌统一编码场景3D几何与物体位置属性
  • 在两个模型上提升空间推理准确率,最高达79.2%(物体尺寸)
  • 无需额外模块,适合部署在资源受限的智能系统中

空间理解是具身智能的核心,支撑机器人操作、导航和自动驾驶等应用。尽管当前视觉语言模型在空间推理基准上表现优异,但先进方法通常依赖额外的空间编码器或推理时的架构修改,增加计算开销。我们提出Space Tokens,一种轻量级、与架构无关的框架,无需额外推理模块即可为视觉语言模型赋予显式的连续空间表示。通过将场景级3D几何与物体中心的空间属性提炼为连续潜在令牌,该方法使这些模态可直接融入思维链推理过程,显著提升模型的空间推理能力。同时,学习到的表示可显式解码以验证其包含有意义的几何信息,统一令牌接口也支持扩展至其他模态。在VSI-Bench上的实验显示,Qwen3-VL-8B提升4.3%,SenseNova-SI-1.3提升1.3%,在物体尺寸估计(79.2%)和房间尺寸估计(75.7%)上达到当前最优性能。结果表明,连续空间令牌是一种高效、可解释且计算成本低的几何推理集成方式。

原文摘要 · Abstract (English)

Spatial understanding is fundamental to embodied intelligence, underpinning applications such as robotic manipulation, embodied navigation, and autonomous driving. Although recent vision-language models (VLMs) have achieved impressive performance on spatial reasoning benchmarks, state-of-the-art approaches typically rely on additional spatial encoders or architectural modifications during inference, increasing computational cost. We introduce Space Tokens, a lightweight, architecture-agnostic framework that equips VLMs with explicit continuous spatial representations without requiring additional inference-time modules. By distilling scene-level 3D geometry and object-centric spatial attributes into continuous latent tokens, our method enables these modalities to be directly incorporated into a chain-of-thought reasoning process, thereby improving the VLM's spatial reasoning capabilities. At the same time, the learned representations can be explicitly decoded to verify that they encode meaningful geometric information, while the unified token interface remains extensible to additional modalities. Experiments on VSI-Bench improve Qwen3-VL-8B by 4.3% and SenseNova-SI-1.3 by 1.3%, while achieving state-of-the-art performance on object size (79.2%) and room size estimation (75.7%). These results demonstrate that continuous spatial tokens provide an effective, interpretable, and computationally efficient mechanism for integrating geometric reasoning into large vision-language models.

空间推理视觉语言模型思维链3D感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。