arXiv:2606.03303cs.AI2026-06被引 5

让通用大模型用智能体框架自动证明数学定理,准确率提升至70%。

LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks

论文配图:LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
图 1 · 摘自论文原文
  • 用智能体框架将复杂问题分解,结合非形式化推理与形式化验证。
  • 在IMO风格题库上,一次性证明成功率从不足10%提升至70%。
  • 可自主处理开放性组合难题,已验证解决凯利图哈密顿分解关键子问题。

大型语言模型在非形式化数学推理中表现优异,但在生成可机器验证的正式证明(如Lean语言)方面表现不佳。本文提出LEAP,一个智能体框架,使通用基础模型在自动化形式化定理证明任务上达到领先水平。LEAP利用基础模型的非形式化推理、指令遵循和迭代自精炼能力,通过持续与Lean编译器交互,将形式化证明构建与非形式化蓝图相衔接。为提供超越日益饱和基准的严格评估,我们引入Lean-IMO-Bench,一个以国际数学奥林匹克(IMO)风格问题为基础、在Lean中形式化的基准,其问题陈述简短但极具挑战性,需多步非平凡推理,涵盖广泛难度等级。实证结果显示,在2025年普特南竞赛(北美大学生数学竞赛)的12道题中,LEAP全部解决,达到前沿形式化数学模型的最新突破水平;在Lean-IMO-Bench上,通用大模型的一次性形式化求解率从低于10%提升至70%,显著超过48%的专用金牌级IMO系统基准。此外,我们展示了LEAP的研究级实用性,自主形式化了复杂组合难题的证明,包括对凯利图偶阶哈密顿分解中的关键子问题的可验证证明。

原文摘要 · Abstract (English)

Large Language Models (LLMs) exhibit strong informal mathematical reasoning but struggle to generate mechanically verifiable proofs in formal languages like Lean. We present LEAP, an agentic framework that enables general-purpose foundation models to achieve state-of-the-art performance on automated formal theorem proving. LEAP leverages foundation model capabilities, such as informal reasoning, instruction following, and iterative self-refinement. By decomposing complex problems into smaller units, the system bridges formal proof construction with informal blueprints through continuous interaction with the Lean compiler. To provide a rigorous evaluation beyond increasingly saturated benchmarks, we introduce Lean-IMO-Bench, a benchmark of IMO-style problems formalized in Lean, with short statements yet highly non-routine and multi-step proofs across a wide range of difficulty levels. Empirically, on the latest 2025 Putnam Competition, an annual mathematics competition for undergraduate students in North America, LEAP solves all 12 problems, matching recent breakthroughs by frontier formal mathematical models. On Lean-IMO-Bench, LEAP boosts the one-shot formal solve rate of general-purpose LLMs from below 10% to 70%, notably surpassing the 48% benchmark set by a specialized, gold-medal-caliber IMO system. Furthermore, we demonstrate LEAP's research-level utility by autonomously formalizing complex proofs for open combinatorial challenges, including a verified proof for a key subproblem in Knuth's Hamiltonian decomposition of even-order Cayley graphs.

形式化证明智能体框架数学推理大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。