arXiv:2507.23726cs.AIcs.CL2025-07被引 100

用形式化验证提升大模型数学证明能力,解出国际奥数题

Seed-Prover: Deep and Broad Reasoning for Automated Theorem Proving

  • 基于Lean反馈迭代优化证明,自动生成并总结中间引理
  • 在IMO真题上正确率78.1%,超越以往最佳水平
  • 新增几何推理引擎,适合竞赛级数学证明任务

大型语言模型虽在长链思维推理中展现强大数学能力,但在定理证明上仍受限于自然语言缺乏明确监督信号。专用形式语言如Lean通过形式化验证提供清晰反馈,支持强化学习训练。本文提出 extbf{Seed-Prover},一种基于引理的全证明推理模型,可依据Lean反馈、已证引理和自我总结迭代优化证明。为解决IMO级别竞赛题,设计三种测试时推理策略,实现深度与广度并重的推理。该模型在形式化后的过往IMO问题上正确率达78.1%,完全饱和MiniF2F基准,PutnamBench得分超50%,大幅领先此前最优方法。针对Lean缺乏几何支持的问题,引入几何推理引擎 extbf{Seed-Geometry},性能优于已有形式化几何系统。利用这两个系统参与IMO 2025,成功完整证明6道题中的5道。本工作显著推进了自动化数学推理的发展,验证了形式化验证结合长链思维的有效性。

原文摘要 · Abstract (English)

LLMs have demonstrated strong mathematical reasoning abilities by leveraging reinforcement learning with long chain-of-thought, yet they continue to struggle with theorem proving due to the lack of clear supervision signals when solely using natural language. Dedicated domain-specific languages like Lean provide clear supervision via formal verification of proofs, enabling effective training through reinforcement learning. In this work, we propose \textbf{Seed-Prover}, a lemma-style whole-proof reasoning model. Seed-Prover can iteratively refine its proof based on Lean feedback, proved lemmas, and self-summarization. To solve IMO-level contest problems, we design three test-time inference strategies that enable both deep and broad reasoning. Seed-Prover proves $78.1\%$ of formalized past IMO problems, saturates MiniF2F, and achieves over 50\% on PutnamBench, outperforming the previous state-of-the-art by a large margin. To address the lack of geometry support in Lean, we introduce a geometry reasoning engine \textbf{Seed-Geometry}, which outperforms previous formal geometry engines. We use these two systems to participate in IMO 2025 and fully prove 5 out of 6 problems. This work represents a significant advancement in automated mathematical reasoning, demonstrating the effectiveness of formal verification with long chain-of-thought reasoning.

数学证明形式化验证大模型推理奥数竞赛

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。