用扩散模型写数学证明,比传统模型更稳更准。
Diffusion-Proof: Recipe for Formal Theorem Proving Beyond Auto-Regressive Generation

- 用扩散模型分步去噪生成完整证明,保持长程逻辑一致
- 在ProofNet和MiniF2F上分别提升1.61%和6.14%
- 能解决连顶尖模型都失败的国际奥数题
提升大语言模型在形式化数学推理方面的能力已成为近年来数学与计算机科学领域的重点。尽管先进自回归(AR)大模型在形式化定理证明上已取得显著进展,但其基于逐词预测的生成方式存在长程连贯性差、错误累积等问题。近期发展的扩散语言模型(dLLMs)通过迭代去噪多标记块生成文本,提供了有前景的替代方案。然而,将dLLMs应用于对长程一致性要求极高的形式数学领域仍研究不足。为此,我们提出**Diffusion-Proof**,据我们所知是首个训练并应用dLLMs进行形式化定理证明的框架。该框架包含两个模型:*dLLM-Prover-7B*,用于生成具有长程连贯策略使用的完整证明;以及* dLLM-Corrector-7B*,一种新颖的大块扩散纠正模型,利用dLLMs的填空能力,结合双向信息实现局部证明修正。大量实验表明,**Diffusion-Proof**在相同数据集训练的AR基线模型上相对显著提升,在ProofNet-Test上绝对提升1.61%,在MiniF2F-Test上提升6.14%。尤为突出的是,**Diffusion-Proof**成功解决了连更先进的思维模型DeepSeek-Prover-V2-7B也无法解决的一道国际数学奥林匹克(IMO)问题,展示了dLLMs在形式化定理证明中的独特优势。
原文摘要 · Abstract (English)
Enhancing the formal math reasoning capabilities of Large Language Models (LLMs) has become a key focus in both mathematical and computer science communities in recent years. While significant progress has been made in using state-of-the-art Auto-Regressive (AR) LLMs for formal theorem proving, these models suffer from inherent limitations. Their next-token prediction generation methods may yield suboptimal performance due to the challenges of long-range coherence and the compounding of errors over long sequences. Recent advancements in diffusion LLMs (dLLMs), which generate text through iterative denoising of a multi-token block, offer a promising alternative. However, the application of dLLMs to formal mathematics, where maintaining long-range coherence is critical, remains largely understudied. To address the challenges above, we propose **Diffusion-Proof**, to the best of our knowledge, the first framework to train and apply dLLMs for formal theorem proving. Our frameworks contain training and inference methods for two models. The first one is *dLLM-Prover-7B*, which performs whole-proof writing with long-range coherent tactic usage. The second one is *dLLM-Corrector-7B*, which is a novel large block diffusion-based correction model. It leverages the in-filling capabilities of dLLMs to perform local proof correction using bi-directional information. Extensive experiments demonstrate that **Diffusion-Proof** relatively significantly outperforms the AR LLM baseline trained under the same dataset. **Diffusion-Proof** achieves an absolute improvement of **1.61%** on ProofNet-Test and **6.14%** on MiniF2F-Test benchmarks compare to the baseline. Notably, **Diffusion-Proof** successfully resolves one IMO problem that more advanced thinking model DeepSeek-Prover-V2-7B could not solve, showcasing the unique advantage of dLLMs in formal theorem proving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。