让大模型像人一样分步思考,精准推理复杂问题。
KAG-Thinker: Interactive Thinking and Deep Reasoning in LLMs via Knowledge-Augmented Generation
- 将复杂问题拆解为可独立求解的逻辑子问题,支持多轮交互。
- 通过自调节机制选择最优知识源,提升推理准确率与覆盖度。
- 适合需要深度分析的领域问答系统开发与研究者使用。
本文提出KAG-Thinker,一个基于轻量级大语言模型的多轮交互式思维与深度推理框架。该框架沿用KAG的逻辑形式引导检索与推理路径,首先通过广度分解将复杂问题拆解为可独立求解的子问题(即逻辑形式),每个逻辑形式以自然语言和逻辑函数双形式表示,并分类为知识检索或推理分析任务。任务间依赖与参数传递通过逻辑函数接口显式建模。在求解过程中,检索函数负责获取指定知识单元的一跳结构化与非结构化信息;数学与演绎函数则执行推理分析。值得注意的是,在知识检索任务中,大模型与外部知识源被视为等价的知识库,通过知识边界模块利用置信度校准与反思推理实现自我调节,选择最优知识源;并通过深度求解模块增强知识获取的全面性。
原文摘要 · Abstract (English)
In this paper, we introduce KAG-Thinker, which upgrade KAG to a multi-turn interactive thinking and deep reasoning framework powered by a dedicated parameter-light large language model (LLM). Our approach constructs a structured thinking process for solving complex problems, enhancing the the logical coherence and contextual consistency of the reasoning process in question-answering (Q&A) tasks on domain-specific knowledge bases (KBs) within LLMs. Following the \textbf{Logical Form} guided retrieval and reasoning technology route of KAG, this framework first decomposes complex questions into independently solvable sub-problems (which are also referred to as logical forms) through \textbf{breadth decomposition}. Each such logical form is represented in two equivalent forms-natural language and logical function-and subsequently classified as either a Knowledge Retrieval or Reasoning Analysis task. Dependencies and parameter passing between these tasks are explicitly modeled via logical function interfaces. In the solving process, the Retrieval function performs retrieval tasks. It retrieves one-hop structured and unstructured information of specified knowledge unit. While the Math and Deduce functions are used to perform reasoning analysis tasks. Secondly, it is worth noting that, in the Knowledge Retrieval sub-problem tasks, LLMs and external knowledge sources are regarded as equivalent KBs. We use the \textbf{knowledge boundary} module to determine the optimal source using self-regulatory mechanisms such as confidence calibration and reflective reasoning, and use the \textbf{depth solving} module to enhance the comprehensiveness of knowledge acquisition...
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。