arXiv:2601.20055cs.CLcs.AI2026-01被引 7

用逻辑验证提升大模型推理可信度,自动纠错并保证结论正确。

VERGE: Formal Refinement and Guidance Engine for Verifiable LLM Reasoning

  • 将大模型输出拆解为可验证的命题,用逻辑公式和定理证明自动校验。
  • 在多个推理基准上,相比单次推理提升18.7%准确率,收敛后表现更优。
  • 适合需要高可靠性推理的场景,如数学证明、法律分析与安全关键系统。

尽管大型语言模型(LLMs)在语法上流畅,但在高风险领域保障其逻辑正确性仍是一大挑战。我们提出一种神经符号框架,结合LLM与SMT求解器,通过迭代精炼生成可验证的答案。该方法将LLM输出分解为原子命题,自动形式化为一阶逻辑,并利用自动化定理证明验证其逻辑一致性。引入三项关键创新:(1) 通过形式语义等价性检查实现多模型共识,消除表面形式指标的语法偏差;(2) 语义路由机制,根据命题类型分配不同验证策略:逻辑命题交由符号求解器,常识推理使用LLM集成;(3) 借助最小修正子集(MCS)精准定位逻辑错误,将二元失败信号转化为可操作的反馈。系统按逻辑状态分类命题,整合多源验证信号生成统一评分并引入方差惩罚。通过结构化反馈迭代优化答案,直至满足接受标准或收敛。该混合方法在可能时提供形式保证,在其他情况下依赖共识验证,推动可信AI发展。使用GPT-OSS-120B模型,VERGE在多个推理基准上平均性能提升18.7%,优于单次推理方法。

原文摘要 · Abstract (English)

Despite the syntactic fluency of Large Language Models (LLMs), ensuring their logical correctness in high-stakes domains remains a fundamental challenge. We present a neurosymbolic framework that combines LLMs with SMT solvers to produce verification-guided answers through iterative refinement. Our approach decomposes LLM outputs into atomic claims, autoformalizes them into first-order logic, and verifies their logical consistency using automated theorem proving. We introduce three key innovations: (1) multi-model consensus via formal semantic equivalence checking to ensure logic-level alignment between candidates, eliminating the syntactic bias of surface-form metrics, (2) semantic routing that directs different claim types to appropriate verification strategies: symbolic solvers for logical claims and LLM ensembles for commonsense reasoning, and (3) precise logical error localization via Minimal Correction Subsets (MCS), which pinpoint the exact subset of claims to revise, transforming binary failure signals into actionable feedback. Our framework classifies claims by their logical status and aggregates multiple verification signals into a unified score with variance-based penalty. The system iteratively refines answers using structured feedback until acceptance criteria are met or convergence is achieved. This hybrid approach delivers formal guarantees where possible and consensus verification elsewhere, advancing trustworthy AI. With the GPT-OSS-120B model, VERGE demonstrates an average performance uplift of 18.7% at convergence across a set of reasoning benchmarks compared to single-pass approaches.

逻辑推理可信AI形式验证大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。