arXiv:2506.07106cs.CLcs.AI2025-06被引 6

用三个协作智能体模拟推理过程,让大模型思考更可信、可解释。

Theorem-of-Thought: A Multi-Agent Framework for Abductive, Deductive, and Inductive Reasoning in Language Models

  • 设计三种推理智能体:归纳、演绎、溯因,协同生成逻辑链条。
  • 在WebOfLies和MultiArith上表现优于CoT等方法,提升推理准确率。
  • 适合需要可解释性推理的场景,如金融、医疗决策辅助。

大语言模型在自然语言推理任务中表现强劲,但其推理过程脆弱且难以解释。传统提示法如思维链(CoT)虽能激发中间步骤或聚合多个输出,却缺乏逻辑结构约束与内部一致性评估机制。本文提出定理之思(ToTh),将推理建模为三个并行智能体的协作,分别模拟溯因、演绎和归纳三种推理模式。每个智能体生成结构化推理图,通过基于自然语言推理(NLI)的贝叶斯信念传播评估每一步置信度,最终选择最一致的推理图得出答案。在符号推理(WebOfLies)与数值推理(MultiArith)基准上的实验表明,ToTh在多个主流大模型上均优于CoT、Self-Consistency及CoT-Decoding,同时生成可解释、逻辑自洽的推理链。结果表明,该框架为构建更鲁棒、类脑的推理系统提供了新方向。代码已开源:https://github.com/KurbanIntelligenceLab/theorem-of-thought。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown strong performance across natural language reasoning tasks, yet their reasoning processes remain brittle and difficult to interpret. Prompting techniques like Chain-of-Thought (CoT) enhance reliability by eliciting intermediate reasoning steps or aggregating multiple outputs. However, they lack mechanisms for enforcing logical structure and assessing internal coherence. We introduce Theorem-of-Thought (ToTh), a novel framework that models reasoning as collaboration among three parallel agents, each simulating a distinct mode of inference: abductive, deductive, and inductive. Each agent produces a reasoning trace, which is structured into a formal reasoning graph. To evaluate consistency, we apply Bayesian belief propagation guided by natural language inference (NLI), assigning confidence scores to each step. The most coherent graph is selected to derive the final answer. Experiments on symbolic (WebOfLies) and numerical (MultiArith) reasoning benchmarks show that ToTh consistently outperforms CoT, Self-Consistency, and CoT-Decoding across multiple LLMs, while producing interpretable and logically grounded reasoning chains. Our findings suggest a promising direction for building more robust and cognitively inspired LLM reasoning. The implementation is available at https://github.com/KurbanIntelligenceLab/theorem-of-thought.

推理框架多智能体可解释性逻辑推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。