arXiv:2504.04942cs.AIcs.LO2025-04被引 7

用神经符号方法自动发现数学证明中的关键引理,效果超越纯神经或纯符号模型。

Lemmanaid: Neuro-Symbolic Lemma Conjecturing

  • 结合大模型生成引理框架与符号推理填充细节
  • 在HOL和AFP数据集上分别发现50%和29%的黄金引理
  • 适合形式化数学与编程语言验证的研究者使用

数学家和计算机科学家正越来越多地利用证明助手来形式化和验证复杂证明,这一过程需要大量专业知识。能否通过自动化手段降低门槛,自动提出有帮助、有趣且新颖的引理?我们提出了首个神经符号引理猜想工具 LEMMANAID,通过在不同数学理论间建立类比来发现新引理。LEMMAID 使用微调的大语言模型生成引理模板以描述其结构,并结合符号方法填充具体内容。在 Isabelle 的 HOL 库和 Archive of Formal Proofs (AFP) 测试集上,LEMMAID 持续优于仅用神经网络或纯符号的方法。以 DeepSeek-coder-6.7B 为后端时,LEMMAID 在 HOL 和 AFP 上分别发现 50% 和 29% 的黄金标准引理,采用提示集成策略后提升至 55% 和 35%。在八元数案例研究中,其发现率达 79%,远超仅用神经方法的 62% 和现有符号工具的 23%。此外,在针对性对比中,其发现的黄金引理数量超过 Claude Opus 4.5 与 GPT-5.2。结果表明,LEMMAID 能在复杂的数学与计算机科学形式化任务中有效生成大量有意义的引理。

原文摘要 · Abstract (English)

Mathematicians and computer scientists are increasingly leveraging proof assistants to formalize and check complex proofs, a task that demands substantial expertise. Can we lower the bar by automating the conjecturing of helpful, interesting and novel lemmas? We present the first neuro-symbolic lemma conjecturing tool, LEMMANAID, designed to discover conjectures by drawing analogies between mathematical theories. LEMMANAID uses a fine-tuned LLM to generate lemma templates that describe the shape of a lemma, and symbolic methods to fill in the details. We compare LEMMANAID against the same LLM fine-tuned to generate lemmas directly, as well as a fully symbolic conjecturing method. On test sets from Isabelle's HOL library and Archive of Formal Proofs (AFP), LEMMANAID consistently outperforms both neural and symbolic methods. Using DeepSeek-coder-6.7B as a backend, LEMMANAID discovers 50% (HOL) and 29% (AFP) of the gold standard lemmas, increasing to 55% and 35% when ensembling prompting strategies. In a case study on Octonions, LEMMANAID discovers 79% of the gold standard lemmas, compared to 62% for neural-only and 23% for the state of the art symbolic tool. Furthermore, in a targeted comparison, LEMMANAID discovers more gold standard lemmas than both Claude Opus 4.5 and GPT-5.2. Our results show that LEMMANAID can conjecture a significant number of interesting lemmas across complex formalizations in mathematics and computer science.

自动推理形式化证明神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。