arXiv:2601.14287cs.LG2026-01ACL被引 6

轻量记忆动态演化,提升大模型长程推理能力

Chain-of-Memory: Lightweight Memory Construction with Dynamic Evolution for LLM Agents

论文配图:Chain-of-Memory: Lightweight Memory Construction with Dynamic Evolution for LLM Agents
图 1 · 摘自论文原文
  • 用动态演化构建记忆链,自动筛选关键信息
  • 在两个基准上准确率提升7.5%-10.4%
  • 计算开销仅为复杂架构的2.7%和6.0%

外部记忆系统对大语言模型代理维持持久知识和执行长时决策至关重要。现有方法通常采用两阶段流程:计算成本高昂的记忆构建(如将数据结构化为图),随后进行简单检索增强生成。然而,我们的实证分析揭示两大根本局限:复杂构建带来高成本但性能提升有限;简单上下文拼接无法弥合检索召回与推理准确性的差距。为此,我们提出CoM(Chain-of-Memory)框架,倡导从重构建转向轻构建、强利用的新范式。CoM引入记忆链机制,通过动态演化将检索片段组织成连贯推理路径,并采用自适应截断剔除无关噪声。在LongMemEval和LoCoMo基准上的大量实验表明,CoM在准确率上超越强基线7.5%-10.4%,同时将令牌消耗降至复杂架构的约2.7%,延迟降低至6.0%。

原文摘要 · Abstract (English)

External memory systems are pivotal for enabling Large Language Model (LLM) agents to maintain persistent knowledge and perform long-horizon decision-making. Existing paradigms typically follow a two-stage process: computationally expensive memory construction (e.g., structuring data into graphs) followed by naive retrieval-augmented generation. However, our empirical analysis reveals two fundamental limitations: complex construction incurs high costs with marginal performance gains, and simple context concatenation fails to bridge the gap between retrieval recall and reasoning accuracy. To address these challenges, we propose CoM (Chain-of-Memory), a novel framework that advocates for a paradigm shift toward lightweight construction paired with sophisticated utilization. CoM introduces a Chain-of-Memory mechanism that organizes retrieved fragments into coherent inference paths through dynamic evolution, utilizing adaptive truncation to prune irrelevant noise. Extensive experiments on the LongMemEval and LoCoMo benchmarks demonstrate that CoM outperforms strong baselines with accuracy gains of 7.5%-10.4%, while drastically reducing computational overhead to approximately 2.7% of token consumption and 6.0% of latency compared to complex memory architectures.

大模型记忆机制推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。