让大模型搜索时像人一样有条理地积累记忆,避免信息丢失。
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search

- 基于查询种子动态生长细粒度记忆片段
- 通过贡献函数重溯并深度优化记忆,减少信息稀释
- 适合需要长期推理的智能体系统研究者
大语言模型在自主规划、检索与推理方面展现出巨大潜力,但迭代思考-搜索循环会积累过长的系统记忆,导致记忆稀释。现有内存管理方法难以捕捉查询与文档间的细粒度语义关系,常丢失关键信息。为此,我们提出MemSearch-o1,一种基于推理对齐的记忆增长与回溯机制的智能搜索框架。该框架从查询中提取记忆种子,动态生成细粒度记忆片段,并通过贡献函数进行重溯与深度精炼,最终构建全局连通的记忆路径。这一机制将内存管理从线性拼接转变为基于路径的、逐标记的结构化增长。在八个基准数据集上的实验表明,MemSearch-o1显著缓解了记忆稀释问题,更有效地激发了多种LLM的推理能力,为面向记忆的智能体智能奠定了坚实基础。
原文摘要 · Abstract (English)
Recent advances in large language models (LLMs) have scaled the potential for reasoning and agentic search, wherein models autonomously plan, retrieve, and reason over external knowledge to answer complex queries. However, the iterative think-search loop accumulates long system memories, leading to memory dilution problem. In addition, existing memory management methods struggle to capture fine-grained semantic relations between queries and documents and often lose substantial information. Therefore, we propose MemSearch-o1, an agentic search framework built on reasoning-aligned memory growth and retracing. MemSearch-o1 dynamically grows fine-grained memory fragments from memory seed tokens from the queries, then retraces and deeply refines the memory via a contribution function, and finally reorganizes a globally connected memory path. This shifts memory management from stream-like concatenation to structured, token-level growth with path-based reasoning. Experiments on eight benchmark datasets show that MemSearch-o1 substantially mitigates memory dilution, and more effectively activates the reasoning potential of diverse LLMs, establishing a solid foundation for memory-aware agentic intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。