arXiv:2608.22215cs.CL2026-08

提出双层记忆框架,让大模型智能选择存与忘,减少冗余并提升长期记忆效率。

Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidation

论文配图:Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidation
图 1 · 摘自论文原文
  • 写入时按价值路由,分三类处理:不存、新增或更新
  • 可删减68%冗余记忆,仍保持98%问答准确率
  • 定期内化知识,让模型自动适应新认知边界

大型语言模型代理在动态环境中运行,知识持续演化。现有记忆系统通常将外部记忆视为单调增长的存储库,导致检索性能下降和计算成本上升。我们提出核心挑战不仅是检索,更是管理知识生命周期:决定何时外部化、更新或最终内化。受神经科学中互补学习系统(CLS)理论启发,我们设计了双层代理记忆框架,通过代价感知的认知路由和周期性参数整合,将记忆管理前置到写入阶段。新信息被分为不写、新写、更新三类,并经小模型到大模型的级联路由,降低开销同时过滤冗余。随后的写回阶段,通过监督微调选择性地将高价值外部记忆固化进模型参数。实验表明,1.7B/8B级联系统可删除高达68%的冗余外部记忆,仅保留不到50%的输入进行写入,但仍维持超过98%的下游问答精确匹配(EM)精度,优于全量保留基线。进一步证明,周期性整合能有效内化外部知识,使路由器随模型认知边界演进而自适应抑制冗余写入。整体上,该框架提供统一的代理记忆范式:先选择性外化,再选择性内化。代码与数据集将在接受后发布。

原文摘要 · Abstract (English)

Large language model (LLM) agents operate in dynamic environments where knowledge continuously evolves. Existing memory systems typically treat external memory as a monotonically growing repository, inevitably leading to retrieval degradation and increasing computational costs over time. We argue that the core challenge is not retrieval alone, but managing the knowledge lifecycle: deciding what to externalize, update, or ultimately internalize. Inspired by Complementary Learning Systems (CLS) theory in neuroscience, we propose Dual-Layer Agentic Memory, a framework that shifts memory management to the write phase through cost-aware epistemic routing and periodic parametric consolidation. Incoming information is categorized as non-write, write-new, or write-update, and routed through a small-to-large model cascade that minimizes routing overhead while filtering redundant memories. A subsequent write-back phase selectively consolidates high-value external memories into model parameters via supervised fine-tuning. Experiments demonstrate the dual efficiency of our approach: a 1.7B/8B cascade prunes up to 68% of redundant external memory while escalating fewer than 50% of inputs, yet retains over 98% of the downstream QA Exact Match (EM) achieved by an exhaustive retention baseline. We further show that periodic consolidation successfully internalizes external knowledge, allowing the router to adaptively suppress redundant writes as the model's epistemic boundaries evolve. Overall, our framework presents a unified paradigm for agent memory: selective externalization followed by selective internalization. Code and dataset will be released upon acceptance.

大模型记忆机制知识管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。