arXiv:2604.18587cs.LGcs.AI2026-04

用编译器输出压缩证明尝试,提升定理证明效率。

Compile to Compress: Boosting Formal Theorem Provers by Compiler Outputs

论文配图:Compile to Compress: Boosting Formal Theorem Provers by Compiler Outputs
图 1 · 摘自论文原文
  • 利用编译器将多样证明尝试压缩为结构化失败模式
  • 在相同测试预算下,优于80亿和320亿参数模型的性能
  • 适合追求高效定理证明的开发者与研究者

大型语言模型在形式化定理证明中展现出巨大潜力,但当前最先进方法往往需要高昂的测试时计算资源,依赖大规模滚动推理或超长上下文窗口。本文针对这一可扩展性瓶颈,利用形式验证中的一个关键结构:编译器将大量多样的证明尝试映射到一组紧凑的结构化失败模式。我们提出一种学习精炼框架,借助这种压缩机制实现高效的模型学习与证明探索。通过基于显式验证器反馈的局部错误修正进行树搜索,避免积累过长的证明历史带来的开销。大量实验表明,该方法在不同规模下均能持续增强基础证明器的推理能力。特别地,在同等测试预算下,我们的方法在PutnamBench上超越了公开报告的约80亿和约320亿参数模型,为下一代验证器引导的推理提供了可扩展范式。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated significant potential in formal theorem proving, yet state-of-the-art performance often necessitates prohibitive test-time compute via massive roll-outs or extended context windows. In this work, we address this scalability bottleneck by exploiting an informative structure in formal verification: the observation that compilers map a vast space of diverse proof attempts to a compact set of structured failure modes. We introduce a learning-to-refine framework that leverages this compression to perform efficient learning and proof exploration. We perform tree search that corrects errors locally conditioned on explicit verifier feedback, thereby circumventing the costs associated with accumulating a long history of proof attempts. Extensive evaluations show that our method consistently amplifies the reasoning capabilities of base provers across varying scales. Notably, our approach achieves state-of-the-art performance on PutnamBench among publicly reported $\sim$8B and $\sim$32B parameter models under comparable test-time budgets, offering a scalable paradigm for next-generation verifier-guided reasoning.

定理证明推理优化高效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。