用多视角搜索和数据清洗,让AI证明定理更高效准确
MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curation

- 通过多视角搜索避免思维固化,提升推理多样性
- 训练数据删去40%冗余后性能不变,且证明更短更优
- 适合研究形式化验证与大模型逻辑推理的学者
自动定理证明(ATP)在形式语言中仍是重大挑战,需严格逻辑推导并应对巨大搜索空间。尽管大语言模型(LLMs)表现亮眼,现有分步证明系统常因搜索引导偏差导致效率低下、策略不佳。本文提出多视角搜索证明器(MPS-Prover),引入两项关键创新:一是高效的后训练数据清洗策略,可删去约40%冗余数据而不影响性能;二是多视角树搜索机制,结合学习到的评判模型与精心设计的启发式规则,实现战术选择多样化,避免陷入无效状态,增强搜索鲁棒性。大量实验表明,MPS-Prover在miniF2F和ProofNet等多个挑战性基准上达到当前最优水平,超越此前70亿参数模型。分析显示,其生成的证明显著更短、更具多样性,优于现有分步与全证明方法,体现高效与有效。本工作推进了基于大模型的形式化推理能力,提供了强大框架与全面分析,助力开发更强定理证明系统。
原文摘要 · Abstract (English)
Automated Theorem Proving (ATP) in formal languages remains a formidable challenge in AI, demanding rigorous logical deduction and navigating vast search spaces. While large language models (LLMs) have shown promising performance, existing stepwise provers often suffer from biased search guidance, leading to inefficiencies and suboptimal proof strategies. This paper introduces the Multi-Perspective Search Prover (MPS-Prover), a novel stepwise ATP system designed to overcome these limitations. MPS-Prover incorporates two key innovations: a highly effective post-training data curation strategy that prunes approximately 40% of redundant training data without sacrificing performance, and a multi-perspective tree search mechanism. This search integrates a learned critic model with strategically designed heuristic rules to diversify tactic selection, prevent getting trapped in unproductive states, and enhance search robustness. Extensive evaluations demonstrate that MPS-Prover achieves state-of-the-art performance on multiple challenging benchmarks, including miniF2F and ProofNet, outperforming prior 7B parameter models. Furthermore, our analyses reveal that MPS-Prover generates significantly shorter and more diverse proofs compared to existing stepwise and whole-proof methods, highlighting its efficiency and efficacy. Our work advances the capabilities of LLM-based formal reasoning and offers a robust framework and a comprehensive analysis for developing more powerful theorem provers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。