arXiv:2604.14641cs.AI2026-04

让大模型学画文字图,能显著提升空间推理能力。

Learning to Draw ASCII Improves Spatial Reasoning in Language Models

论文配图:Learning to Draw ASCII Improves Spatial Reasoning in Language Models
图 1 · 摘自论文原文
  • 用自然语言描述配对应的文字网格图,训练模型生成空间布局。
  • 模型画图能力弱导致推理错误,但练会画图后推理准确率大幅提高。
  • 效果可迁移到其他空间推理任务,适合想提升模型理解力的研究者。

面对复杂空间问题时,人类常通过绘图整理思路,而作图本身也能深化理解。本文探讨大语言模型是否具有类似机制:学习从空间描述生成显式视觉布局,能否真正培养空间理解力?为此,我们构建了Text2Space数据集,包含自然语言描述、真实文字网格布局及空间问答对,可分离布局构建失败与推理失败。采用ASCII字符网格,因其易读、完全在文本空间内、结构可验证。评估发现存在明显“读写不对称”:模型能有效理解文字图,但难以从文本生成。此类生成错误会传递至下游答案。通过在布局生成(文本→文字图)上训练模型,其仅凭文本的空间推理能力显著提升,且无需推理时输出文字图。结合生成与理解训练进一步增强效果。关键的是,这种提升可迁移至三个外部空间推理基准,表明如同人类通过绘图提升空间思维,让模型学会构建显式布局,能真正内化空间理解并泛化到新任务。

原文摘要 · Abstract (English)

When faced with complex spatial problems, humans naturally sketch layouts to organize their thinking, and the act of drawing further sharpens their understanding. In this work, we ask whether a similar principle holds for Large Language Models (LLMs): can learning to construct explicit visual layouts from spatial descriptions instill genuine spatial understanding? We introduce Text2Space, a dataset that pairs natural language descriptions with ground-truth ASCII grid layouts and spatial QA pairs, enabling us to separate failures in constructing spatial representations from failures in reasoning over them. We adopt ASCII because it is human-readable, operates entirely within the token space of language models, and encodes spatial relations in a structurally verifiable form. Our evaluation reveals a pronounced "Read-Write Asymmetry": LLMs interpret ASCII representations effectively but struggle to produce them from text, and these construction errors propagate to incorrect answers downstream. To address this limitation, we train models on layout construction (Text$\rightarrow$ASCII) and find that it significantly improves spatial reasoning from text alone, even without producing any ASCII at inference time. Combining construction with comprehension training further amplifies these gains. Crucially, these improvements transfer to three external spatial reasoning benchmarks, demonstrating that, much as sketching sharpens human spatial thinking, learning to construct explicit layouts instills spatial understanding that generalizes beyond the training format.

空间推理大模型文本生成认知机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。