DRIFT通过分解数学陈述提升形式化准确率,显著改善大模型在定理证明中的知识检索。
DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems

- 将非正式数学命题拆解为可检索的子模块,精准定位所需前提。
- 在ProofNet上使F1分数接近翻倍,ConNF测试集提升超37%。
- 适配不同模型能力,支持动态调整检索策略,适合定理证明研究者。
自动化大语言模型(LLM)对数学命题的形式化仍是重大挑战。当前检索增强的自动形式化方法直接用非正式陈述查询外部库,但忽略了根本问题:非正式表述与数学定理间无直接映射,且难以直接转化为如Lean语言中的形式化原始概念。为此,我们提出DRIFT框架,使LLM能将非正式数学陈述分解为更易处理的‘子组件’,从而实现对Mathlib等数学库中前提的精准检索。此外,DRIFT还检索示意性定理,帮助模型更有效运用前提。我们在ProofNet、ConNF和MiniF2F-test等多个基准上评估,结果表明其持续提升前提检索效果,在ProofNet上相比DPR基线几乎使F1分数翻倍。尤其在分布外的ConNF基准上,使用GPT-4.1和DeepSeek-V3.1分别实现BEq+@10提升42.25%和37.14%。分析显示,数学自动形式化中的检索效果高度依赖于模型自身的知识边界,凸显了与模型能力匹配的自适应检索策略的必要性。
原文摘要 · Abstract (English)
Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and its corresponding formal representation in languages like Lean. Current retrieval-augmented autoformalization methods query external libraries using the informal statement directly, but overlook a fundamental limitation: informal statements lack direct mappings to mathematical theorems and lemmata, nor do those theorems translate trivially into the formal primitives of languages like Lean. To address this, we introduce DRIFT, a novel framework that enables LLMs to decompose informal mathematical statements into smaller, more tractable "sub-components". This facilitates targeted retrieval of premises from mathematical libraries such as Mathlib. Additionally, DRIFT retrieves illustrative theorems to help models use premises more effectively in formalization tasks. We evaluate DRIFT across diverse benchmarks (ProofNet, ConNF, and MiniF2F-test) and find that it consistently improves premise retrieval, nearly doubling the F1 score compared to the DPR baseline on ProofNet. Notably, DRIFT demonstrates strong performance on the out-of-distribution ConNF benchmark, with BEq+@10 improvements of 42.25% and 37.14% using GPT-4.1 and DeepSeek-V3.1, respectively. Our analysis shows that retrieval effectiveness in mathematical autoformalization depends heavily on model-specific knowledge boundaries, highlighting the need for adaptive retrieval strategies aligned with each model's capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。