arXiv:2606.12594cs.AI2026-06被引 1

用更少算力实现高效形式化证明,突破开源模型性能瓶颈。

Pythagoras-Prover: Advancing Efficient Formal Proving via Augmented Lean Formalisation

论文配图:Pythagoras-Prover: Advancing Efficient Formal Proving via Augmented Lean Formalisation
图 1 · 摘自论文原文
  • 分层训练+动态过滤,让模型从简单到复杂逐步学证明。
  • 4B模型在MiniF2F上超越671B大模型,32B解出93道普特南题。
  • 自蒸馏增强数据,减少对原始证明的依赖,适合实证研究者。

现代Lean定理证明器需大量训练与推理计算,受限于验证证明数据稀缺及长推理轨迹,导致监督微调(SFT)和采样成本高昂。本文提出Pythagoras-Prover,一个面向实际算力预算的开源高效证明器家族,包含4B与32B参数的自回归模型,以及首个扩散式证明器(4B),可在推理时迭代优化证明。为提升训练效率,构建分层的Lean验证语料库,按难易度划分,实现渐进式教学;训练中采用动态推理过滤机制,在8k-token上下文内保留有效证明轨迹。引入增强型形式化(ALF),通过自蒸馏生成已知问题的变体,扩充训练信号但无需全部正式验证。实验表明,Pythagoras-Prover-4B在MiniF2F-Test上以~167倍更少参数达86.1% pass@32,优于DeepSeek-Prover-V2-671B(82.4%);Pythagoras-Prover-32B在该基准达93.0%,并解决PutnamBench中93/672题。发布MiniF2F-ALF,一个受扰动的抗污染基准,所有模型精度下降,但32B仍最优,4B持平前代最优模型Goedel-Prover-V2-32B。

原文摘要 · Abstract (English)

Modern Lean theorem provers achieve strong performance only with substantial training and inference compute, driven in part by scarce verified proof data and the long reasoning traces of formal proof search, making both supervised fine-tuning (SFT) and sampling expensive. We introduce Pythagoras-Prover, a compute-efficient open-source family of Lean theorem provers built for practical compute budgets. The family spans two generation paradigms: autoregressive models at 4B and 32B parameters, and a first proof-of-concept diffusion-based prover (4B) that iteratively refines Lean proofs at inference time. For training efficiency, we build a Lean-verified corpus stratified into easy, medium, and hard problems for curriculum SFT, so models acquire proof skills progressively from shorter, simpler proofs to longer, harder ones. During SFT, a dynamic proof-reasoning filtering scheme preserves informative proof traces while keeping each instance within an 8k-token context budget. We also introduce Augmented Lean Formalisation (ALF), which expands scarce verified corpora into variants of formal statements, populated via self-distillation for extra training signal without formally verifying every mutated instance. By perturbing known problems while preserving their formal character, ALF reduces reliance on any statement's surface form. Empirically, Pythagoras-Prover-4B surpasses DeepSeek-Prover-V2-671B at pass@32 on MiniF2F-Test (86.1% vs 82.4%) with ~167x fewer parameters, while Pythagoras-Prover-32B sets the open-source state of the art at 93.0% on MiniF2F-Test and solves 93 of 672 PutnamBench problems. We release MiniF2F-ALF, an ALF-mutated contamination-sensitive benchmark on which every evaluated model loses accuracy; here our 32B remains strongest and our 4B matches the prior state of the art, Goedel-Prover-V2-32B.

形式化证明开源模型训练优化自蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。