用模型协作让大模型更高效地证明数学定理
MA-LoT: Model-Collaboration Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Proving

- 分两步:先生成完整证明,再由模型协作纠错
- 在MiniF2F-Test上达61.07%准确率,远超基线
- 适合想提升形式化证明能力的研究者
使用可计算机验证的语言(如Lean)解决数学问题已对数学与计算机科学领域产生深远影响。当前主流方法依赖单一大型语言模型(LLM)生成完整证明或执行树搜索,但难以平衡这两项任务。我们提出MA-LoT:基于模型协作的长思维链框架,用于Lean4定理证明。该框架通过模型协作机制,将自然语言生成完整证明与错误分析修正分离,并在长思维链中实现LLM与Lean4验证器的结构化交互。为实现此框架,我们设计了新型的LoT-迁移学习训练-推理流程,使LLM无需特殊标注数据即可具备长思维链能力。大量实验表明,本框架在Lean4版MiniF2F-Test数据集上达到61.07%的准确率,显著优于DeepSeek-V3(33.61%)、单模型树搜索(InternLM-Step-Prover,50.70%)和完整证明生成(Godel-Prover,55.33%)等基线。此外,研究揭示了长思维链与形式化验证结合在更广泛视角下的潜力。
原文摘要 · Abstract (English)
Solving mathematical problems using computer-verifiable languages like Lean has significantly impacted the mathematical and computer science communities. State-of-the-art methods utilize a single Large Language Model (LLM) to generate complete proof or perform tree search, but they fail to balance these tasks. We propose **MA-LoT**: *Model-CollAboration Lean-based Long Chain-of-Thought*, a comprehensive framework for Lean4 theorem proving to solve this issue. It separates the cognition tasks of general NL for whole-proof generation and error analysis for proof correction using the model-collaboration method. We achieve this by structured interaction of the LLM and Lean4 verifier in Long CoT. To implement the framework, we propose the novel *LoT-Transfer Learning* training-inference pipeline, which enables the Long CoT thinking capability to LLMs without special data annotation. Extensive experiment shows that our framework achieves a **61.07%** accuracy rate on the Lean4 version of the MiniF2F-Test dataset, largely outperforming DeepSeek-V3 (33.61%), single-model tree search (InternLM-Step-Prover, 50.70%), and whole-proof generation (Godel-Prover, 55.33%) baselines. Furthermore, our findings highlight the potential of combining Long CoT with formal verification for a more insightful generation in a broader perspective.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。