arXiv:2607.23019cs.AIcs.LO2026-07中稿 · the 20th Conferenc…

用逻辑编程修复大模型推理链中的错误,提升多步推理准确率。

Reason Popper-ly: Patching In-Context Reasoning with Inductive Logic Programming

论文配图:Reason Popper-ly: Patching In-Context Reasoning with Inductive Logic Programming
图 1 · 摘自论文原文
  • 用归纳逻辑编程从推理过程学习关系组合规则,实时验证每一步。
  • 在最长推理链上,小模型准确率提升48个百分点,大模型提升15点。
  • 可定位错误类型,适合需要可解释性推理的场景。

链式思维提示使大语言模型能处理多步推理任务,但生成的中间步骤未必逻辑正确。本文提出 Reason Popper-ly,一种神经符号框架,利用归纳逻辑编程(ILP)从推理轨迹中学习关系组合规则,并作为在线验证器对每一步进行纠错。给定模型生成的推理链,该方法检查每一步是否符合学习到的规则,诊断错误类型,用符号推导的修正方案重写错误步骤,并重新生成后续部分,使模型基于已验证的推理链输出最终答案。我们在 CLUTRR 基准上评估,使用五种语言模型,推理链长度为 2 到 10 步。所有模型下,Reason Popper-ly 均显著优于标准 CoT,小模型在最长链上最高提升 48 个百分点,前沿模型提升 15 个百分点。相比完全外部符号流水线,本方法在更难样本上表现更好,保留模型成功推理基础的同时仅纠正可验证的推理错误。此外,步骤级 ILP 验证提供了细粒度错误分类,超越最终答案准确率的诊断价值。

原文摘要 · Abstract (English)

Chain-of-thought (CoT) prompting enables large language models (LLMs) to tackle multi-step reasoning tasks, yet the generated intermediate steps are not guaranteed to be logically sound. We present Reason Popper-ly, a neurosymbolic framework that uses inductive logic programming (ILP) to learn relation composition rules from reasoning traces and deploys them as an online verifier for step-level correction. Given an LLM-generated trace, the method checks each inferred step against the learned rule table, diagnoses the violation type, rewrites incorrect steps with symbolically derived repairs, and regenerates the remaining suffix so that the model can produce its final answer conditioned on a verified trace. We evaluate on CLUTRR, a multi-hop kinship reasoning benchmark, using five language models over reasoning chains of 2 to 10 hops. Across all models, Reason Popper-ly consistently improves terminal accuracy over standard CoT, with gains of up to 48 percentage points for small models and 15 points for frontier models on the longest chains. Compared with a fully exogenous symbolic pipeline, our method performs better on harder instances by preserving the model's successful grounding while correcting only verifiable reasoning failures. In addition, step-level ILP verification yields a fine-grained error taxonomy that provides diagnostic insight beyond final-answer accuracy.

逻辑推理链式思维神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。