综述几何题求解中的多模态推理方法与挑战
Plane Geometry Problem Solving with Multi-modal Reasoning: A Survey
- 按编码-解码框架分类现有几何题求解方法
- 指出当前模型在编码阶段易产生幻觉现象
- 揭示基准数据集存在数据泄露风险,适合研究者参考
平面几何问题求解(PGPS)近年来成为评估大视觉-语言模型多模态推理能力的重要基准。尽管关注度持续上升,但该领域仍缺乏系统性的研究综述。为此,本文对现有PGPS研究进行了全面梳理:首先将方法归类为编码-解码框架,并总结其编码器与解码器的输出格式;随后基于架构设计对编码器和解码器进行分类分析;最后提出当前主要挑战及未来方向。特别指出,编码-解码架构在编码阶段易出现幻觉问题,且现有PGPS基准存在数据泄露风险。
原文摘要 · Abstract (English)
Plane geometry problem solving (PGPS) has recently gained significant attention as a benchmark to assess the multi-modal reasoning capabilities of large vision-language models. Despite the growing interest in PGPS, the research community still lacks a comprehensive overview that systematically synthesizes recent work in PGPS. To fill this gap, we present a survey of existing PGPS studies. We first categorize PGPS methods into an encoder-decoder framework and summarize the corresponding output formats used by their encoders and decoders. Subsequently, we classify and analyze these encoders and decoders according to their architectural designs. Finally, we outline major challenges and promising directions for future research. In particular, we discuss the hallucination issues arising during the encoding phase within encoder-decoder architectures, as well as the problem of data leakage in current PGPS benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。