arXiv:2601.10101cs.AIcs.CL2026-01中稿 · The Web Conference

用矩阵结构规划逻辑推理,让大模型更稳更可信。

Matrix as Plan: Structured Logical Reasoning with Feedback-Driven Replanning

  • 用矩阵记录推理步骤关系,保持全局一致性。
  • 通过反馈重规划修复错误,提升答案可靠性。
  • 不依赖外部求解器,适合复杂符号推理任务。

随着网络知识与语义日益复杂,提升大语言模型(LLMs)的理解与推理能力愈发重要。链式思维(CoT)提示虽能增强推理能力,但在依赖符号表达和严格演绎规则的任务上仍显不足。神经符号方法通过外部求解器保证形式正确性,但对输出格式敏感,易因微小误差导致处理失败。纯LLM方法避免解析脆弱性,却缺乏结构化表示与过程纠错机制。为此,我们提出MatrixCoT,一种基于矩阵的结构化CoT框架。通过归一化自然语言表达并添加显式引用字段,引入矩阵规划方法以保留步骤间的全局关系。该计划成为可验证的产物,执行更稳定。同时引入反馈驱动的重规划机制,在语义等价约束下识别遗漏与缺陷,重构并压缩依赖矩阵,生成更可信的最终答案。在五个逻辑推理基准和五种LLM上的实验表明,无需外部求解器,MatrixCoT显著提升了复杂符号推理任务中的鲁棒性与可解释性,同时保持竞争力表现。

原文摘要 · Abstract (English)

As knowledge and semantics on the web grow increasingly complex, enhancing Large Language Models (LLMs)' comprehension and reasoning capabilities has become particularly important. Chain-of-Thought (CoT) prompting has been shown to enhance the reasoning capabilities of LLMs. However, it still falls short on logical reasoning tasks that rely on symbolic expressions and strict deductive rules. Neuro-symbolic methods address this gap by enforcing formal correctness through external solvers. Yet these solvers are highly format-sensitive, and small instabilities in model outputs can lead to frequent processing failures. The LLM-driven approaches avoid parsing brittleness, but they lack structured representations and process-level error-correction mechanisms. To further enhance the logical reasoning capabilities of LLMs, we propose MatrixCoT, a structured CoT framework with a matrix-based plan. Specifically, we normalize and type natural language expressions and attach explicit citation fields, and introduce a matrix-based planning method to preserve global relations among steps. The plan thus becomes a verifiable artifact and execution becomes more stable. For verification, we also add a feedback-driven replanning mechanism. Under semantic-equivalence constraints, it identifies omissions and defects, rewrites and compresses the dependency matrix, and produces a more trustworthy final answer. Experiments on five logical-reasoning benchmarks and five LLMs show that, without relying on external solvers, MatrixCoT enhances both the robustness and interpretability of LLMs when tackling complex symbolic reasoning tasks, while maintaining competitive performance.

逻辑推理结构化推理大模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。