让大模型学会追踪推理依赖关系,高效复用知识。
Dep-Search: Learning Dependency-Aware Reasoning Traces with Persistent Memory
- 引入显式控制机制,按依赖关系拆解问题
- 在7个数据集上显著提升多跳问答准确率
- 适合需要复杂推理的智能问答系统
大型语言模型在复杂推理任务中表现卓越,尤其当结合搜索机制以系统性探索外部知识库时。从传统检索增强生成(RAG)发展到更复杂的基于搜索的框架,通过显式搜索策略实现多步推理。然而,现有框架仍严重依赖隐式的自然语言推理来决定搜索策略及如何跨步骤利用检索信息。这种对隐式推理的依赖导致难以管理子问题间的依赖关系、高效复用先前检索的知识,以及通过强化学习学习最优搜索策略。为解决这些问题,我们提出Dep-Search,一种依赖感知的搜索框架,通过GRPO整合结构化推理、检索与持久化记忆。Dep-Search引入显式控制机制,使模型能够分解具有依赖关系的问题,按需检索信息,访问记忆中存储的知识,并将长推理上下文总结为可复用的记忆条目。在七个多样化问答数据集上的大量实验表明,Dep-Search显著提升了大模型处理复杂多跳推理任务的能力,在不同模型规模下均显著优于强基线。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks, particularly when augmented with search mechanisms that enable systematic exploration of external knowledge bases. The field has evolved from traditional retrieval-augmented generation (RAG) frameworks to more sophisticated search-based frameworks that orchestrate multi-step reasoning through explicit search strategies. However, existing search frameworks still rely heavily on implicit natural language reasoning to determine search strategies and how to leverage retrieved information across reasoning steps. This reliance on implicit reasoning creates fundamental challenges for managing dependencies between sub-questions, efficiently reusing previously retrieved knowledge, and learning optimal search strategies through reinforcement learning. To address these limitations, we propose Dep-Search, a dependency-aware search framework that advances beyond existing search frameworks by integrating structured reasoning, retrieval, and persistent memory through GRPO. Dep-Search introduces explicit control mechanisms that enable the model to decompose questions with dependency relationships, retrieve information when needed, access previously stored knowledge from memory, and summarize long reasoning contexts into reusable memory entries. Through extensive experiments on seven diverse question answering datasets, we demonstrate that Dep-Search significantly enhances LLMs' ability to tackle complex multi-hop reasoning tasks, achieving substantial improvements over strong baselines across different model scales.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。