arXiv:2512.20617cs.CV2025-12被引 9

构建空间能力层级框架,揭示多模态大模型的空间认知发展规律。

SpatialTree: How Spatial Abilities Branch Out in MLLMs

  • 提出四层空间能力架构:感知→心智地图→模拟→智能体能力
  • 27项子能力评估显示高层能力高度相关,底层能力相互独立
  • 发现低层到高层存在强迁移,但盲目强化思考反而损害直觉感知

认知科学表明空间能力呈递进发展——从感知到推理再到交互。然而在多模态大模型(MLLMs)中,这一层次结构仍不清晰,多数研究局限于少数任务。本文提出SpatialTree,一个受认知科学启发的层级框架,将空间能力划分为四个层级:低层感知(L1)、心智地图(L2)、模拟(L3)和代理能力(L4)。基于此,构建首个以能力为中心的分层基准,全面评估主流MLLMs在27项子能力上的表现。结果表明:L1能力基本正交,而高层能力间显著相关,体现日益增强的依赖性。通过针对性监督微调,发现L1内部存在负迁移,但低层向高层存在强跨层迁移且具协同效应。进一步探索提升路径发现,简单强化学习(RL)鼓励过度“思考”不可靠:虽提升复杂推理,却损害直观感知。为此提出一种自动抑制冗余思辨的自思考策略,使RL在所有层级均稳定提升性能。SpatialTree为理解与系统化扩展MLLMs的空间能力提供了概念验证框架。

原文摘要 · Abstract (English)

Cognitive science suggests that spatial ability develops progressively-from perception to reasoning and interaction. Yet in multimodal LLMs (MLLMs), this hierarchy remains poorly understood, as most studies focus on a narrow set of tasks. We introduce SpatialTree, a cognitive-science-inspired hierarchy that organizes spatial abilities into four levels: low-level perception (L1), mental mapping (L2), simulation (L3), and agentic competence (L4). Based on this taxonomy, we construct the first capability-centric hierarchical benchmark, thoroughly evaluating mainstream MLLMs across 27 sub-abilities. The evaluation results reveal a clear structure: L1 skills are largely orthogonal, whereas higher-level skills are strongly correlated, indicating increasing interdependency. Through targeted supervised fine-tuning, we uncover a surprising transfer dynamic-negative transfer within L1, but strong cross-level transfer from low- to high-level abilities with notable synergy. Finally, we explore how to improve the entire hierarchy. We find that naive RL that encourages extensive "thinking" is unreliable: it helps complex reasoning but hurts intuitive perception. We propose a simple auto-think strategy that suppresses unnecessary deliberation, enabling RL to consistently improve performance across all levels. By building SpatialTree, we provide a proof-of-concept framework for understanding and systematically scaling spatial abilities in MLLMs.

多模态大模型空间认知能力层级强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。