用分块状态加速Lean 4中的自动定理证明搜索
LeanTree: Accelerating White-Box Proof Search with Factorized States in Lean 4
- 将复杂证明状态拆解为独立分支,降低搜索难度
- 初步实验显示白盒方法在某些场景优于黑盒
- 适合需要可解释性与正确性保障的推理研究者
自动化定理证明(ATP)自人工智能诞生以来就是经典难题,因其状态和动作空间庞大而难以突破。大语言模型(LLMs)虽被视作有前景的启发式方法,但缺乏正确性保证,需与证明验证器交互。现有交互方式分为黑盒(不利用中间状态)与白盒(支持增量构建和状态检查)。尽管黑盒方法直接受益于大模型进展,白盒方法却相对滞后。本文提出LeanTree,包含:(i) 在Lean 4中实现的状态分块工具,将复杂证明状态分解为更简单的独立分支;(ii) 一组经过分块的中间状态数据集。该白盒工具相比黑盒方法具有多项优势:简化评估、减少上下文需求、生成更丰富的训练数据、支持多状态并行搜索、促进状态复用,并可在出错时提供反馈。初步结果表明,在某些场景下白盒方法优于黑盒方案。
原文摘要 · Abstract (English)
Automated theorem proving (ATP) has been a classical problem in artificial intelligence since its inception, yet it remains challenging due to its vast state and action space. Large language models (LLMs) have recently emerged as a promising heuristic for ATP, but they lack correctness guarantees and thus require interaction with a proof verifier. Such interactions typically follow one of two approaches: black-box interaction, which does not utilize intermediate proof states, or white-box approaches, which allow for incremental proof construction and examination of intermediate states. While black-box approaches have directly benefited from recent LLM advances, white-box methods have comparatively lagged behind. In this paper, we address this gap by introducing LeanTree, which consists of (i) a tool built in the Lean 4 language that factorizes complex proof states into simpler, independent branches, and (ii) a dataset of these factorized intermediate states. Our white-box tooling offers several advantages over black-box approaches: it simplifies evaluation, reduces necessary context, generates richer training data, enables parallel search across multiple states, supports efficient reuse of states, and provides feedback in case of errors. Our preliminary results hint that white-box approaches outperform black-box alternatives in some settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。