arXiv:2602.11182cs.CL2026-02ACL被引 5

让大模型学会高效用记忆,提升长对话推理能力

MetaMem: Evolving Meta-Memory for Knowledge Utilization through Self-Reflective Symbolic Optimization

  • 通过自我反思优化元记忆,自动提炼跨任务经验
  • 在多个任务上比强基线高出3.6%以上
  • 适合需要长期记忆与逻辑推理的AI应用

现有记忆系统虽能延长大语言模型(LLMs)的交互上下文,但常破坏会话中的逻辑与时间关联,导致记忆碎片化、推理下降。本文提出MetaMem框架,引入自演化元记忆机制,通过自我反思推理过程并执行更新动作,迭代提炼可迁移的知识利用经验。积累的元记忆单元作为显式知识利用经验,引导模型从分散的记忆片段中系统识别并整合关键证据。大量实验表明,MetaMem显著优于强基线,性能提升超过3.6%。所有代码与数据集已公开于https://github.com/OpenBMB/MetaMem。

原文摘要 · Abstract (English)

Existing memory systems enable Large Language Models (LLMs) to support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. However, while recent approaches have succeeded in constructing effective memories, they often disrupt the inherent logical and temporal relationships within interaction sessions, resulting in fragmented memory units and degraded reasoning performance. In this paper, we propose MetaMem, a novel framework that augments memory systems with a self-evolving meta-memory, aiming to teach LLMs how to effectively utilize memorized knowledge. During meta-memory optimization, MetaMem iteratively distills transferable knowledge utilization experiences across different tasks by self-reflecting on reasoning processes and performing actions to update the current meta-memory state. The accumulated meta-memory units serve as explicit knowledge utilization experiences, guiding the LLM to systematically identify and integrate critical evidence from scattered memory fragments. Extensive experiments demonstrate the effectiveness of MetaMem, which significantly outperforms strong baselines by over 3.6%. All codes and datasets are available at https://github.com/OpenBMB/MetaMem.

大模型记忆元记忆推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。