arXiv:2601.19605cs.CL2026-01

通过分步验证与局部修正,提升大模型自然语言推理的可解释性与可靠性。

Decompose-and-Formalise: Recursively Verifiable Natural Language Inference

  • 将推理拆解为原子步骤树,逐层验证并定位错误节点。
  • 在五个模型上验证率提升21.6%~48.9%,修复迭代次数显著减少。
  • 适合需要高可信解释的复杂推理场景,如医疗、法律决策支持。

近期研究发现,将大语言模型(LLMs)与定理证明器(TPs)结合,在神经符号流水线中有助于自然语言蕴含(NLI)的验证与解释的证明引导优化。然而,将此类优化扩展至自然语境下的NLI仍具挑战:长句、语法复杂输入及深层多步论证会放大自动形式化错误,单一局部不匹配即可导致整个证明失效。现有方法常因难以定位故障段落或步骤,而采用代价高昂的全局重生成。为此,本文提出分解-形式化框架:(i)将前提-假设对分解为原子步骤的蕴含树;(ii)自底向上验证以精确定位失败节点;(iii)基于诊断结果进行局部修正,而非全量重生成。此外,为提升自动形式化的忠实度,引入θ-替换机制,在事件逻辑形式中强制一致的论元角色绑定。在使用五种LLM骨干模型的多种推理任务上,本方法实现最高解释验证率,相较最先进方法分别提升26.2%、21.7%、21.6%和48.9%,同时降低修复迭代次数与运行时间,并保持强NLI准确率。

原文摘要 · Abstract (English)

Recent work has shown that integrating large language models (LLMs) with theorem provers (TPs) in neuro-symbolic pipelines helps with entailment verification and proof-guided refinement of explanations for natural language inference (NLI). However, scaling such refinement to naturalistic NLI remains difficult: long, syntactically rich inputs and deep multi-step arguments amplify autoformalisation errors, where a single local mismatch can invalidate the proof. Moreover, current methods often handle failures via costly global regeneration due to the difficulty of localising the responsible span or step from prover diagnostics. Aiming to address these problems, we propose a decompose-and-formalise framework that (i) decomposes premise-hypothesis pairs into an entailment tree of atomic steps, (ii) verifies the tree bottom-up to isolate failures to specific nodes, and (iii) performs local diagnostic-guided refinement instead of regenerating the whole explanation. Moreover, to improve faithfulness of autoformalisation, we introduce $θ$-substitution in an event-based logical form to enforce consistent argument-role bindings. Across a range of reasoning tasks using five LLM backbones, our method achieves the highest explanation verification rates, improving over the state-of-the-art by 26.2%, 21.7%, 21.6% and 48.9%, while reducing refinement iterations and runtime and preserving strong NLI accuracy.

自然语言推理可解释性形式化验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。