用改进的广度优先搜索实现高效自动定理证明,性能超越复杂方法。
BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Proving
- 通过筛选难题、优化策略和长度归一化,提升广度优先搜索效率
- 在MiniF2F上达到72.95%准确率,刷新基准
- 适合对可扩展性与简洁性有要求的定理证明研究者
大语言模型(LLMs)在基于Lean4的自动定理证明中引发广泛关注,有效树搜索方法对探索庞大证明空间至关重要。现有方法多依赖价值函数或蒙特卡洛树搜索(MCTS),而更简单的广度优先搜索(BFS)潜力尚未被充分挖掘。本文提出BFS-Prover,一个可扩展的专家迭代框架,包含三项创新:第一,在每轮专家迭代中实施策略性数据过滤,排除可通过束搜索解决的问题,聚焦更难案例;第二,利用编译器错误反馈自动标注的状态-策略对,通过直接偏好优化(DPO)提升样本效率,使模型更倾向于选择有产出的扩展;第三,在BFS中引入长度归一化,鼓励探索更深的证明路径。BFS-Prover在MiniF2F测试集上取得72.95%的领先成绩,挑战了复杂树搜索方法的必要性,表明在合理扩展下,BFS可实现竞争力表现。为促进该领域研究,模型已开源至https://huggingface.co/ByteDance-Seed/BFS-Prover-V1-7B。
原文摘要 · Abstract (English)
Recent advancements in large language models (LLMs) have spurred growing interest in automatic theorem proving using Lean4, where effective tree search methods are crucial for navigating the underlying large proof search spaces. While the existing approaches primarily rely on value functions and/or Monte Carlo Tree Search (MCTS), the potential of simpler methods like Best-First Tree Search (BFS) remains underexplored. In this paper, we investigate whether BFS can achieve competitive performance in large-scale theorem proving tasks. We present BFS-Prover, a scalable expert iteration framework, featuring three key innovations. First, we implement strategic data filtering at each expert iteration round, excluding problems solvable via beam search node expansion to focus on harder cases. Second, we improve the sample efficiency of BFS through Direct Preference Optimization (DPO) applied to state-tactic pairs automatically annotated with compiler error feedback, refining the LLM's policy to prioritize productive expansions. Third, we employ length normalization in BFS to encourage exploration of deeper proof paths. BFS-Prover achieves a state-of-the-art score of $72.95\%$ on the MiniF2F test set and therefore challenges the perceived necessity of complex tree search methods, demonstrating that BFS can achieve competitive performance when properly scaled. To facilitate further research and development in this area, we have open-sourced our model at https://huggingface.co/ByteDance-Seed/BFS-Prover-V1-7B.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。