arXiv:2603.19715cs.AI2026-03被引 3

用大模型+符号系统自动证明系统软件,准确率超77%。

Neuro-Symbolic Proof Generation for Scaling Systems Software Verification

  • 结合大模型与定理工具进行分步推理搜索
  • 在seL4上成功证明77.6%的定理,多步证明能力更强
  • 适合想自动化验证复杂系统的研究人员

通过交互式定理证明进行形式化验证在保障关键系统正确性方面日益重要,但构建大型证明脚本仍高度依赖人工,限制了可扩展性。大型语言模型(LLM)在数学推理方面的进展使其融入软件验证愈发可行。本文提出一种神经符号式证明生成框架,用于自动化系统级验证中的证明搜索。该框架采用最佳优先树搜索策略,在证明状态空间中反复调用LLM生成下一步候选。神经侧通过证明状态-步骤对数据集微调LLM;符号侧则集成多种ITP工具,用于修复被拒步骤、过滤与排序证明状态,并在搜索停滞时自动处理子目标。这种协同机制实现了数据高效的语言模型适配和语义引导的搜索空间剪枝。我们在新开发的Isabelle REPL上实现该框架,其暴露细粒度证明状态与自动化工具,并在FVEL seL4基准及额外Isabelle项目上进行评估。在seL4上,系统成功证明高达77.6%的定理,显著优于此前基于LLM的方法和独立Sledgehammer,且在多步证明上表现更优。在其他Isabelle基准上的结果表明其具备良好泛化能力,为可扩展自动化软件验证提供了可行路径。

原文摘要 · Abstract (English)

Formal verification via interactive theorem proving is increasingly used to ensure the correctness of critical systems, yet constructing large proof scripts remains highly manual and limits scalability. Advances in large language models (LLMs), especially in mathematical reasoning, make their integration into software verification increasingly promising. This paper introduces a neuro-symbolic proof generation framework designed to automate proof search for system-level verification projects. The framework performs a best-first tree search over proof states, repeatedly querying an LLM for the next candidate proof step. On the neural side, we fine-tune LLMs using datasets of proof state-step pairs; on the symbolic side, we incorporate a range of ITP tools to repair rejected steps, filter and rank proof states, and automatically discharge subgoals when search progress stalls. This synergy enables data-efficient LLM adaptation and semantics-informed pruning of the search space. We implement the framework on a new Isabelle REPL that exposes fine-grained proof states and automation tools, and evaluate it on the FVEL seL4 benchmark and additional Isabelle developments. On seL4, the system proves up to 77.6\% of the theorems, substantially surpassing previous LLM-based approaches and standalone Sledgehammer, while solving significantly more multi-step proofs. Results across further Isabelle benchmarks demonstrate strong generalization, indicating a viable path toward scalable automated software verification.

形式验证大模型自动证明

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。