小模型击败大模型,用自修正和合成数据提升自动定理证明能力
Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correction
- 用逐步升级的合成题目训练模型,掌握更复杂定理
- 通过Lean编译器反馈自我修正证明,88.1%在MiniF2F pass@32
- 开源模型在小算力下超越大模型,适合数学研究与AI推理应用
我们提出Goedel-Prover-V2,一系列开源语言模型,在自动化定理证明上达到新SOTA。基于标准专家迭代与强化学习流程,引入三项关键创新:(1) 结构化数据合成:生成难度递增的合成任务,训练模型掌握更复杂定理;(2) 验证器引导的自修正:利用Lean编译器反馈,让模型迭代修订证明;(3) 模型平均:合并模型检查点,缓解训练后期输出多样性下降问题。小型模型Goedel-Prover-V2-8B在MiniF2F上达84.6% pass@32,虽仅是DeepSeek-Prover-V2-671B的1/80大小,仍表现更优。旗舰模型Goedel-Prover-V2-32B在标准模式下达88.1% pass@32,自修正模式下达90.4%,大幅领先先前SOTA。此外,该模型在PutnamBench上以pass@184解决86题,成为首个开源模型登顶,远超DeepSeek-Prover-V2-671B的47题(pass@1024),且使用更小模型与更低算力。2025年7–8月发布时,其为所有开源定理证明模型中综合性能最强,并在有限测试计算预算下跻身顶尖模型行列(含闭源系统)。模型、代码与数据已公开于https://github.com/Goedel-LM/Goedel-Prover-V2。
原文摘要 · Abstract (English)
We introduce Goedel-Prover-V2, a series of open-source language models that set a new state-of-the-art in automated theorem proving. Built on the standard expert iteration and reinforcement learning pipeline, our approach incorporates three key innovations: (1) Scaffolded data synthesis: We generate synthetic tasks of increasing difficulty to train the model to master increasingly complex theorems; (2) Verifier-guided self-correction: We enable the model to iteratively revise its proofs by leveraging feedback from the Lean compiler; (3) Model averaging: We merge model checkpoints to mitigate the decrease in model output diversity in later stages of training. Our small model, Goedel-Prover-V2-8B, reaches 84.6% pass@32 on MiniF2F and outperforms DeepSeek-Prover-V2-671B under the same metric, despite being 80X smaller. Our flagship model, Goedel-Prover-V2-32B, achieves 88.1% on MiniF2F at pass@32 in standard mode and 90.4% in self-correction mode, outperforming prior SOTA by a large margin. Additionally, our flagship model solves 86 problems on PutnamBench at pass@184, securing the first place among open-source models on the leaderboard, surpassing DeepSeek-Prover-V2-671B's record of solving 47 problems by pass@1024 with a significantly smaller model size and compute budget. At the time of its release (July-August 2025), Goedel-Prover-V2 achieves the strongest overall performance among all open-source theorem provers. It also ranks among the top-performing models--including closed-source systems with publicly reported performance--under a constrained test-time compute budget. Our models, code, and data are released at https://github.com/Goedel-LM/Goedel-Prover-V2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。