arXiv:2604.11600cs.CV2026-04ACL被引 1

用统一形式语言解析平面与立体几何,提升大模型理解能力

Geoparsing: Diagram Parsing for Plane and Solid Geometry with a Unified Formal Language

论文配图:Geoparsing: Diagram Parsing for Plane and Solid Geometry with a Unified Formal Language
图 1 · 摘自论文原文
  • 设计统一形式语言,融合平面与立体几何结构与关系
  • 构建29K规模数据集,含2万平面与9千立体几何样本
  • 显著提升大模型几何推理能力,适合几何认知研究者

多模态大模型在几何推理方面仍面临瓶颈,主要源于对细粒度视觉元素的感知不足。尽管形式语言已助力平面几何理解,但需空间认知的立体几何仍鲜有探索。本文提出一种融合平面与立体几何的统一形式语言,全面覆盖几何结构与语义关系。构建GDP-29K数据集,包含2万平面与9千立体几何样本,均来自真实世界来源,并配有精确形式描述。为确保语法正确性与几何一致性,提出结合监督微调与可验证奖励的强化学习训练范式。实验表明,该方法达当前最优解析性能。进一步证明,解析出的形式描述可作为关键认知支架,显著增强多模态大模型在下游几何推理任务中的表现。数据与代码已开源。

原文摘要 · Abstract (English)

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but continue to struggle with geometric reasoning, primarily due to the perception bottleneck regarding fine-grained visual elements. While formal languages have aided plane geometry understanding, solid geometry which requires spatial understanding remains largely unexplored. In this paper, we address this challenge by designing a unified formal language that integrates plane and solid geometry, comprehensively covering geometric structures and semantic relations. We construct GDP-29K, a large-scale dataset comprising 20k plane and 9k solid geometry samples collected from diverse real-world sources, each paired with its ground-truth formal description. To ensure syntactic correctness and geometric consistency, we propose a training paradigm that combines Supervised Fine-Tuning with Reinforcement Learning via Verifiable Rewards. Experiments show that our approach achieves state-of-the-art parsing performance. Furthermore, we demonstrate that our parsed formal descriptions serve as a critical cognitive scaffold, significantly boosting MLLMs' capabilities for downstream geometry reasoning tasks. Our data and code are available at Geoparsing.

几何推理形式语言多模态模型数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。