让大模型的检索策略与记忆库同步进化,提升长期智能体性能。
CoEvo-Mem: Co-Evolving Retrieval Policy and Memory Bank for LLM Agents

- 检索策略与记忆库通过反馈闭环协同优化
- 在7个基准上达到当前最佳效果
- 适合需要长期记忆与持续学习的任务
随着任务和会话中记忆积累,长时序大模型智能体的性能取决于查询特定的检索与持续的记忆更新。然而,现有方法通常只优化记忆访问(如迭代查询改写或自适应检索策略)或记忆演化(如结构更新),忽略了关键反馈环:检索决定哪些记忆获得使用信号,而更新后的记忆库又重塑未来的检索行为。本文提出 extbf{CoEvo-Mem},一个闭环框架,实现检索策略与记忆库的共同演化。每个查询下,冻结的大模型生成路由相关的查询重写与路由先验,轻量级残差路由器在线修正。检索到的上下文作为两个学习过程的耦合接口:任务结果为路由决策分配信用,轨迹条件反馈更新记忆值与图关系。这些更新改变后续查询中记忆的排序与选择,从而形成闭环。为缓解耦合带来的非平稳性,CoEvo-Mem 交替固定记忆库更新路由器,或固定检索策略演化记忆库。在七个多样化基准上, extbf{CoEvo-Mem} 达到最先进性能,验证了检索-记忆协同演化的必要性。
原文摘要 · Abstract (English)
As memories accumulate across tasks and sessions, the performance of long-term LLM agents depends jointly on query-specific retrieval and continual memory refinement. However, existing methods typically optimize either memory access, through iterative query refinement or adaptive retrieval policies, or memory evolution such as structural update. This separation overlooks a fundamental feedback loop: retrieval determines which memories receive usage signals, while updated memory bank reshape future retrieval. We propose \textbf{CoEvo-Mem}, a closed-loop framework for co-evolving the retrieval policy and memory bank. For each query, a frozen LLM generates route-specific query rewrites and a routing prior, which a lightweight residual router corrects online. The retrieved context serves as the coupling interface between the two learning processes: task outcomes assign credit to routing decisions, while trajectory-conditioned feedback updates memory values and graph relations. These updates alter how memories are ranked and selected for subsequent queries, thereby closing the feedback loop. To mitigate coupling induced non-stationarity, CoEvo-Mem alternates between updating the router with the memory bank fixed and evolving the memory bank with the retrieval policy fixed. Across seven diverse benchmarks, \textbf{CoEvo-Mem} achieves state-of-the-art performance, demonstrating the importance of retrieval-memory coevolution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。