arXiv:2506.11487cs.AI2025-06NeurIPS被引 23

不训练模型,用神经符号协同也能高效证明数学定理。

Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models

论文配图:Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models
图 1 · 摘自论文原文
  • 用自然语言生成子目标,替代复杂推理过程。
  • 零训练下解决80.7% miniF2F问题,还发现8处形式化错误。
  • 适合想快速验证定理或调试形式化的人使用。

近期进展如 DeepSeek-Prover-V2-671B 和 Kimina-Prover-Preview-72B 显现出基于强化学习的大规模训练在自动定理证明中的主导趋势。令人惊讶的是,我们发现仅通过精心设计的神经符号协调现有现成推理模型与策略步证明器,无需任何训练即可达到相当性能。本文提出改进版 DSP+ 框架,在每个阶段引入细粒度集成的神经符号增强:(1) 草稿阶段,引导推理模型生成简洁自然语言子目标,移除思考标记和对人工证明的引用;(2) 构图阶段,将子目标自动形式化并关联假设,根据预设规则屏蔽含语法错误的构图行;(3) 证明阶段,紧密集成符号搜索方法如 Aesop 与步证明器,完成子目标的证明。实验显示,不需额外训练或微调,DSP+ 在 miniF2F、ProofNet、PutnamBench 上分别解决 80.7%、32.8%、24/644 道题,且资源消耗更低。该方法成功证明了 miniF2F 中未被此前工作解决的 exttt{imo_2019_p1}(IMO 2019 第一题)。此外,其生成的证明模式对人类专家可读,帮助识别形式化错误,共发现 8 个 miniF2F 中错误形式化的命题。结果凸显了经典推理范式在当前大模型时代的潜力。所有组件将开源。

原文摘要 · Abstract (English)

Recent advancements, such as DeepSeek-Prover-V2-671B and Kimina-Prover-Preview-72B, demonstrate a prevailing trend in leveraging reinforcement learning (RL)-based large-scale training for automated theorem proving. Surprisingly, we discover that even without any training, careful neuro-symbolic coordination of existing off-the-shelf reasoning models and tactic step provers can achieve comparable performance. This paper introduces \textbf{DSP+}, an improved version of the Draft, Sketch, and Prove framework, featuring a \emph{fine-grained and integrated} neuro-symbolic enhancement for each phase: (1) In the draft phase, we prompt reasoning models to generate concise natural-language subgoals to benefit the sketch phase, removing thinking tokens and references to human-written proofs; (2) In the sketch phase, subgoals are autoformalized with hypotheses to benefit the proving phase, and sketch lines containing syntactic errors are masked according to predefined rules; (3) In the proving phase, we tightly integrate symbolic search methods like Aesop with step provers to establish proofs for the sketch subgoals. Experimental results show that, without any additional model training or fine-tuning, DSP+ solves 80.7\%, 32.8\%, and 24 out of 644 problems from miniF2F, ProofNet, and PutnamBench, respectively, while requiring fewer budgets compared to state-of-the-arts. DSP+ proves \texttt{imo\_2019\_p1}, an IMO problem in miniF2F that is not solved by any prior work. Additionally, DSP+ generates proof patterns comprehensible by human experts, facilitating the identification of formalization errors; For example, eight wrongly formalized statements in miniF2F are discovered. Our results highlight the potential of classical reasoning patterns besides the RL-based training. All components will be open-sourced.

定理证明神经符号自动化推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。