arXiv:2511.11990cs.AI2025-11ACL被引 2

用直接依赖检索提升数学陈述自动形式化准确率

Improving Autoformalization Using Direct Dependency Retrieval

  • 从自然语言直接生成形式库依赖候选,再用后缀数组高效验证
  • 在50万样本数据上训练的模型,召回率与精度显著优于现有方法
  • 适合从事形式化验证、AI辅助数学证明的研究者使用

深度学习与形式数学的融合推动了形式化验证研究。陈述自动形式化作为关键第一步,旨在将非正式描述转化为可机器验证的表达,但仍面临重大挑战。主要难点在于现有方法缺乏上下文感知能力,导致形式定义和定理的幻觉。此外,当前检索增强方法在形式库依赖检索中精度和召回率低下,且难以扩展以利用不断增长的公开数据集。为此,我们提出基于DDR(直接依赖检索)的新颖检索增强框架。DDR方法直接从数学自然语言描述生成候选库依赖,并通过高效的后缀数组检查验证其在形式库中的存在。借助该高效搜索机制,我们构建了一个包含超过50万样本的依赖检索数据集,并微调了一个高精度的DDR模型。实验结果表明,我们的DDR模型在检索精度和召回率上均显著优于现有最先进方法。因此,集成DDR的自动形式化器在单次尝试准确率和多次尝试稳定性上均展现出持续优势,优于使用传统基于选择的RAG方法的模型。

原文摘要 · Abstract (English)

The convergence of deep learning and formal mathematics has spurred research in formal verification. Statement autoformalization, a crucial first step in this process, aims to translate informal descriptions into machine-verifiable representations but remains a significant challenge. The core difficulty lies in the fact that existing methods often suffer from a lack of contextual awareness, leading to hallucination of formal definitions and theorems. Furthermore, current retrieval-augmented approaches exhibit poor precision and recall for formal library dependency retrieval, and lack the scalability to effectively leverage ever-growing public datasets. To bridge this gap, we propose a novel retrieval-augmented framework based on DDR (\textit{Direct Dependency Retrieval}) for statement autoformalization. Our DDR method directly generates candidate library dependencies from natural language mathematical descriptions and subsequently verifies their existence within the formal library via an efficient suffix array check. Leveraging this efficient search mechanism, we constructed a dependency retrieval dataset of over 500,000 samples and fine-tuned a high-precision DDR model. Experimental results demonstrate that our DDR model significantly outperforms SOTA methods in both retrieval precision and recall. Consequently, an autoformalizer equipped with DDR shows consistent performance advantages in both single-attempt accuracy and multi-attempt stability compared to models using traditional selection-based RAG methods.

形式化验证自然语言检索增强数学AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。