arXiv:2510.27448cs.AI2025-10被引 4

用形式语言生成高保真几何题,提升多模态模型解题能力

GeoFM: Enhancing Geometric Reasoning of MLLMs via Synthetic Data Generation through Formal Language

  • 通过形式语言系统生成多样且正确的几何问题
  • 在MathVista和GeoQA上超越GPT-4o 18.7%与16.5%
  • 适合需要强几何推理的多模态模型研究者

多模态大语言模型在处理多模态任务方面备受关注,但在数学几何推理方面受限于高质量几何数据的匮乏。为此,合成几何数据成为关键策略。现有方法通过重述或扩展已有问题,并使用预设规则和模板生成几何图像与题目,但常导致数据多样性不足或引入噪声,且合成图像变化有限,偏离真实几何图示。为此,我们提出GeoFM,一种新型几何数据合成方法。GeoFM利用形式语言在度量空间中探索条件组合,借助符号引擎确保正确性,生成与原始问题不同但高保真的几何问题。实验表明,使用该数据训练的模型在MathVista上比GPT-4o高出18.7%,在GeoQA上高出16.5%;同时优于领先开源模型,在MathVista上高5.7%,在GeoQA上高2.7%。

原文摘要 · Abstract (English)

Multi-modal Large Language Models (MLLMs) have gained significant attention in both academia and industry for their capabilities in handling multi-modal tasks. However, these models face challenges in mathematical geometric reasoning due to the scarcity of high-quality geometric data. To address this issue, synthetic geometric data has become an essential strategy. Current methods for generating synthetic geometric data involve rephrasing or expanding existing problems and utilizing predefined rules and templates to create geometric images and problems. However, these approaches often produce data that lacks diversity or is prone to noise. Additionally, the geometric images synthesized by existing methods tend to exhibit limited variation and deviate significantly from authentic geometric diagrams. To overcome these limitations, we propose GeoFM, a novel method for synthesizing geometric data. GeoFM uses formal languages to explore combinations of conditions within metric space, generating high-fidelity geometric problems that differ from the originals while ensuring correctness through a symbolic engine. Experimental results show that our synthetic data significantly outperforms existing methods. The model trained with our data surpass the proprietary GPT-4o model by 18.7\% on geometry problem-solving tasks in MathVista and by 16.5\% on GeoQA. Additionally, it exceeds the performance of a leading open-source model by 5.7\% on MathVista and by 2.7\% on GeoQA.

几何推理合成数据多模态模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。