提出矩阵式思维结构,提升大模型复杂推理效率与准确性。
Chain or tree? Re-evaluating complex reasoning from the perspective of a matrix of thought
- 用行列通信机制实现横向纵向双重思考,减少冗余节点。
- 在三类任务中推理时间仅为基线14.4%,准确率显著提升。
- 适合需要深度多策略推理的复杂任务研究者使用。
大型语言模型在处理复杂抽象任务时因推理能力不足导致准确率下降。现有的链式思维(CoT)和树状思维(ToT)存在层内冗余与路径单一等固有缺陷。虽有研究结合检索增强生成(RAG)缓解幻觉问题,但根本结构缺陷仍存。尤其在多实体、多跳信息场景下,检索到的验证知识常含大量碎片化、表面化或错误信息,误导模型推理。为此,本文提出新型思维结构——矩阵思维(MoT),通过“列-单元通信”机制,在水平与垂直维度同时探索问题,支持多策略深度思考,降低列内节点冗余,增强推理能力。此外,引入事实修正机制,利用RAG检索的知识图谱三元组与原文构建知识单元,纠正错误答案。在24点游戏、问答评估和命题写作三项任务上进行实验,结果表明,该框架优于当前最优方法,推理时间仅为基础方法的14.4%,验证了其高效性与准确性。代码已开源:https://github.com/lyfiter/mtqa。
原文摘要 · Abstract (English)
Large Language Models (LLMs) face significant accuracy degradation due to insufficient reasoning ability when dealing with complex and abstract tasks. Thought structures such as Chain of Thought (CoT) and Tree of Thought (ToT) focus on enhancing the reasoning capability of LLMs. However, they suffer from inherent drawbacks such as redundancy within the same layer of the tree structure and the singularity of the paths in the chain structure. Some studies have utilized Retrieval-Augmented Generation (RAG) methods to enhance CoT and ToT in mitigating hallucinations in LLMs, yet the fundamental shortcomings of the thought structures still persist. Furthermore, when dealing with multi-entity and multi-hop information, the retrieved verification knowledge often contains large amounts of fragmented, superficial, or even erroneous data, misleading the reasoning process of LLMs. To address these issues, we propose the Matrix of Thought (MoT), a novel and efficient thought structure for LLMs. MoT explores problems in both horizontal and vertical dimensions through a "column-cell communication" mechanism, enabling LLMs to actively engage in multi-strategy and deep thinking while reducing redundancy in the thought nodes within the column cells, thereby enhancing the reasoning capability of LLMs. Additionally, through a fact-correction mechanism, it leverages the knowledge graph triples retrieved by RAG and the original text to construct knowledge units and correct erroneous answers. To validate the effectiveness of this method, we conducted extensive experiments in three tasks: 24-point game, question answering evaluation, and proposition writing.The results demonstrate that our framework outperforms state-of-the-art methods, with reasoning time only 14.4\% of that of the baseline method, proving its efficiency and accuracy. The code for framework is available at https://github.com/lyfiter/mtqa.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。