让大模型像画思维图一样多步推理,提升复杂问题解决能力
On the Diagram of Thought
- 用动态思维图替代线性思考,支持自生成、自修正推理路径
- 通过确定性验证器确保语法与类型约束,结果可审计可追踪
- 基于范畴论构建数学框架,适合需要严谨推理的科研与工程场景
大语言模型在多数任务中表现优异,但在需要结构化多步推理的复杂问题上常出错。我们提出思维图(Diagram of Thought, DoT)框架,使单一LLM能够构建并导航其内在推理地图。模型不再线性思考,而是生成动态思想图谱,可提出多种推理路径、自我批判步骤,并将验证过的洞见合成最终结论。该过程几乎无需外部搜索或规划器,仅依赖一个确定性的在线验证器,用于语法约束的类型化轨迹、寄存器约束及可选求解器检查。为明确可靠性目标,我们将DoT建立在范畴论数学框架之上:将被接受的类型化推理记录视为割片拓扑中的图表,将选定提议子图的合成建模为有限极限。在谓词片段中,同一对象等价于反向信息顺序下的方差反转余极限。该形式化体系提供可审计的逐步类型推理轨迹,将类型子轨迹的语义保证与非约束自然语言文本及未认证操作边分离。
原文摘要 · Abstract (English)
Large Language Models (LLMs) excel at many tasks but often falter on complex problems that require structured, multi-step reasoning. We introduce the Diagram of Thought (DoT), a framework that enables a single LLM to build and navigate a mental map of its reasoning. Instead of thinking in a straight line, the model constructs a dynamic diagram of ideas, where it can propose different lines of thought, critique its own steps, and synthesize validated insights into a final conclusion. This process is controller-light: it does not require an external search algorithm or planner, but it does use a deterministic online validator for grammar-constrained typed traces, register constraints, and optional solver checks. To clarify the reliability target of this process, we ground DoT in a mathematical framework from category theory. We interpret accepted typed reasoning records as diagrams in a slice topos and model synthesis of the selected proposer subdiagram as a finite limit. In the predicate fragment, this same object is equivalently a variance-reversed colimit in the opposite information order. The resulting formalism gives an auditable, step-by-step trace of the LLM's typed reasoning and separates semantic guarantees for the typed subtrace from unconstrained natural-language text and uncertified operational edges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。