用神经符号演化框架持续积累可复用的正式证明结构。
ProofEvolve: Neuro-Symbolic Evolution for Formal Automated Theorem Proving
- 神经模型生成可验证的证明变换操作,符号内核逐步验证
- 在三个竞赛级基准上平均解题率领先现有系统
- 适合需要长期知识积累的自动化定理证明研究者
自动化定理证明为科学发现的递归自我改进提供了天然基础。然而,现有神经证明系统未能完全保持这一递归结构:学习过程应随时间自提升。现有方法要么通过昂贵的权重更新将证明经验嵌入模型参数,要么仅在当前问题中保留已验证的中间推导。此外,这些方法仍严重依赖稀疏的完整证明反馈,即使未成功的部分尝试也包含有用发现。为此,我们提出ProofEvolve,一种神经符号框架,通过神经模型演化显式的、形式化验证的符号证明结构,以突破知识边界。在此框架中,神经模型提出变异算子(如分解、修复、模式重组),符号内核(Lean)验证每一步证明转换。在演化循环中,ProofEvolve对生成的证明有向无环图(DAG)计算已验证闭包。每个问题内,系统在行为索引归档中演化部分AND-OR证明DAG;跨问题时,内核检查的模式提取将新证明的子DAG加入持久化模式库。证明DAG通过类型化模式重组继承已解结果,每个残余前提均暴露为新子目标。该演化过程保留不完整尝试中的验证成果,并使其可用于后续证明,且不削弱形式正确性。在三个竞赛级Lean基准上,ProofEvolve实现了所评估证明系统中的最高平均求解率。
原文摘要 · Abstract (English)
Automated theorem proving offers a natural foundation for recursive self-improvement in scientific discovery. However, existing neural provers do not fully preserve this recursive structure, where the learning process should be self-improving over time. Existing methods either embed proof experience into model parameters through expensive weight updates, or keep verified intermediate deductions only within the current problem. In addition, these methods also heavily rely on sparse whole-proof feedback, even when unsuccessful partial attempts contain useful discoveries. To close the gap, we propose ProofEvolve, a neuro-symbolic framework that evolves explicit, formally verified symbolic proof structures with neural models to decisively expand the knowledge boundary. In this framework, the neural model proposes variation operators, including decompositions, repairs, and schema recombinations. The symbolic Lean kernel verifies every proof transition. Over the evolution loops, ProofEvolve computes verified closure over the resulting proof directed acyclic graphs (DAGs). Within each problem, ProofEvolve evolves partial AND-OR proof DAGs in a behaviorally indexed archive. Across problems, kernel-checked schema extraction adds newly proved sub-DAGs to a persistent schema library. Proof DAGs inherit the solved results through typed schema recombination, with every residual premise exposed as a new subgoal. This evolutionary process preserves verified results from incomplete attempts and makes them available for later proofs without weakening formal soundness. Across three competition-level Lean benchmarks, ProofEvolve achieves the highest average solve rate among the evaluated proof systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。