arXiv:2505.18492cs.AI2025-05被引 1

用神经符号框架解决数学题中构造答案的难题

Formally Solving Answer-Construction Problems in Lean

论文配图:Formally Solving Answer-Construction Problems in Lean
图 1 · 摘自论文原文
  • 结合通用大模型枚举候选答案,用证明专用模型生成可验证证明
  • 在PutnamBench和MathArena上分别解决17和18道题,且答案无循环依赖
  • 适合需要严格形式化验证的数学竞赛或自动化定理证明场景

大型语言模型(LLMs)在形式化数学推理方面取得了显著进展。数学竞赛题可分为两类:定理证明题要求给出完全指定命题的证明,而答案构造题则要求构造一个满足给定规范的答案对象并证明其正确性。现有数学推理引擎主要针对定理证明题,而答案构造题仍研究较少。该任务具有挑战性,因为模型能力不匹配——通用大模型更擅长答案构造,而证明专用模型更擅长生成证明;同时,仅靠Lean检查无法排除非法的循环论证。为此,我们提出枚举-猜想-证明(ECP)框架,用于在Lean中解决答案构造问题。ECP利用通用大模型进行有界枚举并构造候选答案,再调用证明专用大模型生成机器可验证的证明,并引入可接受性检查以确保答案是标准形式且不包含循环论证。在PutnamBench和自动形式化数学竞赛数据集MathArena上的实验表明,ECP在指定推理预算下分别解决了17/346和18/75个实例,且答案与证明均符合可接受性要求,优于现有大模型基线。

原文摘要 · Abstract (English)

Large language models (LLMs) have achieved remarkable progress in formal mathematical reasoning. Mathematical competition problems fall into two broad types: theorem-proving problems ask for a proof of a fully specified statement, whereas answer-construction problems ask the solver to construct an answer object and prove that it satisfies the stated specification. Existing mathematical reasoning engines mainly target theorem-proving problems, yet answer-construction problems remain less studied. This setting is challenging because model capabilities are misaligned, with general LLMs better suited to answer construction and prover LLMs better suited to proof generation, and because Lean proof checking alone does not rule out inadmissible circular witnesses. To close this gap, we introduce Enumerate-Conjecture-Prove (ECP), a neuro-symbolic framework for solving answer-construction problems in Lean. ECP uses general LLMs to perform bounded enumeration and construct candidate answers, and invokes prover LLMs to produce machine-checked proofs. ECP introduces admissibility checking to ensure that each answer is canonical and does not involve a circular argument. On answer-construction problems from PutnamBench and autoformalized MathArena, ECP formally solves 17/346 PutnamBench instances and 18/75 MathArena instances with admissible answers and proofs, outperforming LLM baselines at aligned inference budgets.

形式化推理数学竞赛神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。