arXiv:2602.07055cs.AIcs.CL2026-02被引 20

探索空间认知:测试大模型如何主动构建并更新地图

Theory of Space: Can Foundation Models Construct Spatial Beliefs through Active Exploration?

  • 让模型主动探索环境,逐步构建空间认知
  • 发现模型在自主探索时性能骤降,且知识易丢失
  • 适合研究具身智能与空间推理的学者

空间具身智能要求代理在部分可观测条件下通过行动获取信息。尽管多模态基础模型在被动感知方面表现优异,但其在主动、自主探索方面的能力仍待研究。我们提出「空间理论」,即代理通过自主探索获取信息,并基于连续的局部观察构建、修正和利用空间信念。我们设计了一个以好奇心驱动探索为目标的基准测试,关键创新在于空间信念探测机制,可实时揭示模型内部的空间表征。对当前最先进模型的评估揭示了若干关键瓶颈:首先存在主动-被动差距,代理在自主收集信息时性能显著下降;其次探索效率低下,远不如程序化代理系统化;通过信念探测发现,虽然感知是初始瓶颈,但全局信念存在不稳定性,导致空间知识随时间退化。最后,通过伪信念范式发现信念惯性,代理无法用新证据更新过时先验,该问题在视觉模型中尤为严重。结果表明,现有基础模型在主动探索中难以维持连贯、可更新的空间信念。

原文摘要 · Abstract (English)

Spatial embodied intelligence requires agents to act to acquire information under partial observability. While multimodal foundation models excel at passive perception, their capacity for active, self-directed exploration remains understudied. We propose Theory of Space, defined as an agent's ability to actively acquire information through self-directed, active exploration and to construct, revise, and exploit a spatial belief from sequential, partial observations. We evaluate this through a benchmark where the goal is curiosity-driven exploration to build an accurate cognitive map. A key innovation is spatial belief probing, which prompts models to reveal their internal spatial representations at each step. Our evaluation of state-of-the-art models reveals several critical bottlenecks. First, we identify an Active-Passive Gap, where performance drops significantly when agents must autonomously gather information. Second, we find high inefficiency, as models explore unsystematically compared to program-based proxies. Through belief probing, we diagnose that while perception is an initial bottleneck, global beliefs suffer from instability that causes spatial knowledge to degrade over time. Finally, using a false belief paradigm, we uncover Belief Inertia, where agents fail to update obsolete priors with new evidence. This issue is present in text-based agents but is particularly severe in vision-based models. Our findings suggest that current foundation models struggle to maintain coherent, revisable spatial beliefs during active exploration.

空间认知具身智能探索策略大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。