arXiv:2604.20570cs.CV2026-04中稿 · CVPR被引 1

首次评测生成式模型的3D空间智能,发现训练可提升其空间推理能力。

Exploring Spatial Intelligence from a Generative Perspective

论文配图:Exploring Spatial Intelligence from a Generative Perspective
图 1 · 摘自论文原文
  • 构建GSI-Bench基准,通过真实与合成数据评估图像生成中的空间约束遵守能力。
  • 在合成数据上微调模型后,不仅生成更准确,理解能力也显著提升。
  • 适合研究多模态模型空间推理、生成质量优化的研究者。

空间智能对多模态大模型至关重要,但现有基准主要从理解角度评估。本文探讨现代生成或统一型多模态模型是否具备生成式空间智能(GSI),即生成图像时尊重并操作3D空间约束的能力,并能否衡量或提升。提出GSI-Bench,首个通过空间锚定图像编辑量化GSI的基准,包含两个互补组件:基于3D先验引导生成与过滤流程构建的高质量真实世界数据集GSI-Real,以及具有可控空间操作和全自动化标注的大规模合成基准GSI-Syn。结合统一评估协议,实现可扩展、模型无关的空间合规性与编辑保真度评估。实验表明,在GSI-Syn上微调统一多模态模型,可在合成与真实任务中取得显著提升,并意外改善下游空间理解能力。这是首次明确证据,证明生成式训练能实质性增强空间推理,为多模态模型空间智能发展开辟新路径。

原文摘要 · Abstract (English)

Spatial intelligence is essential for multimodal large language models, yet current benchmarks largely assess it only from an understanding perspective. We ask whether modern generative or unified multimodal models also possess generative spatial intelligence (GSI), the ability to respect and manipulate 3D spatial constraints during image generation, and whether such capability can be measured or improved. We introduce GSI-Bench, the first benchmark designed to quantify GSI through spatially grounded image editing. It consists of two complementary components: GSI-Real, a high-quality real-world dataset built via a 3D-prior-guided generation and filtering pipeline, and GSI-Syn, a large-scale synthetic benchmark with controllable spatial operations and fully automated labeling. Together with a unified evaluation protocol, GSI-Bench enables scalable, model-agnostic assessment of spatial compliance and editing fidelity. Experiments show that fine-tuning unified multimodal models on GSI-Syn yields substantial gains on both synthetic and real tasks and, strikingly, also improves downstream spatial understanding. This provides the first clear evidence that generative training can tangibly strengthen spatial reasoning, establishing a new pathway for advancing spatial intelligence in multimodal models.

空间智能生成模型多模态评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。