通过经验学习提升数学定理证明能力,攻克本科至博士级难题
Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experience
- 基于大规模智能体强化学习积累形式化证明经验
- 在PutnamBench上解决88%本科题,Putnam 2025题11道9小时内完成
- 适合研究形式化数学推理与自动化证明的学者
大型语言模型在生成严谨数学证明方面取得显著进展。然而,在形式语言(如Lean)中进行定理证明仍具挑战性且计算成本高,尤其针对本科及以上级别问题。本文提出Seed-Prover 1.5,一种通过大规模智能体强化学习训练的形式化定理证明模型,并结合高效的测试时扩展(TTS)工作流。通过与Lean及其他工具的持续交互,模型在强化学习过程中不断积累经验,显著提升形式化定理证明的能力与效率。同时,借助自然语言证明的最新进展,我们的TTS工作流高效弥合了自然语言与形式语言之间的差距。相较于现有最优方法,Seed-Prover 1.5以更小的计算开销实现更优性能:在PutnamBench(本科级)上解决88%,Fate-H(研究生级)上解决80%,Fate-X(博士级)上解决33%的问题。值得注意的是,使用本系统,在9小时内成功解决了Putnam 2025年12道题中的11道。研究结果表明,基于高质量形式化反馈的经验学习具有巨大潜力,将推动形式化数学推理的未来发展。
原文摘要 · Abstract (English)
Large language models have recently made significant progress to generate rigorous mathematical proofs. In contrast, utilizing LLMs for theorem proving in formal languages (such as Lean) remains challenging and computationally expensive, particularly when addressing problems at the undergraduate level and beyond. In this work, we present \textbf{Seed-Prover 1.5}, a formal theorem-proving model trained via large-scale agentic reinforcement learning, alongside an efficient test-time scaling (TTS) workflow. Through extensive interactions with Lean and other tools, the model continuously accumulates experience during the RL process, substantially enhancing the capability and efficiency of formal theorem proving. Furthermore, leveraging recent advancements in natural language proving, our TTS workflow efficiently bridges the gap between natural and formal languages. Compared to state-of-the-art methods, Seed-Prover 1.5 achieves superior performance with a smaller compute budget. It solves \textbf{88\% of PutnamBench} (undergraduate-level), \textbf{80\% of Fate-H} (graduate-level), and \textbf{33\% of Fate-X} (PhD-level) problems. Notably, using our system, we solved \textbf{11 out of 12 problems} from Putnam 2025 within 9 hours. Our findings suggest that scaling learning from experience, driven by high-quality formal feedback, holds immense potential for the future of formal mathematical reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。