arXiv:2511.20857cs.CLcs.AI2025-11被引 122

评测大模型在持续任务中自我演化记忆的能力,解决长期学习难题。

Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory

  • 构建连续任务流数据集,让模型动态更新记忆
  • 提出ReMem框架,实现推理-动作-记忆协同进化
  • 覆盖10个数据集,验证经验复用的有效性

状态保持对大语言模型(LLM)代理完成长期规划与问题求解至关重要,但其记忆管理与演化仍缺乏系统研究。现有评估多聚焦静态对话场景,仅被动检索记忆回答问题,忽略了在持续任务流中积累与复用经验的动态能力。在交互式助手或具身代理等真实场景中,模型常无法从过往交互中学习,丢失关键上下文,亟需部署时演化能力,即在运行中持续检索、整合并更新记忆。为此,我们提出Evo-Memory,一个全面的流式基准与评估框架,用于测试LLM代理的自演化记忆。该框架将数据集组织为连续任务流,要求模型在每次交互后搜索、适应并演化记忆。我们统一实现了十余种代表性记忆模块,并在10个多样化的多轮目标导向与单轮推理/问答数据集上进行评估。为更好评测经验复用,我们提供基线方法ExpRAG以检索和利用过往经验,并进一步提出ReMem——一种将推理、任务动作与记忆更新紧密集成的行动-思考-记忆精炼流水线,实现持续优化。

原文摘要 · Abstract (English)

Statefulness is essential for large language model (LLM) agents to perform long-term planning and problem-solving. This makes memory a critical component, yet its management and evolution remain largely underexplored. Existing evaluations mostly focus on static conversational settings, where memory is passively retrieved from dialogue to answer queries, overlooking the dynamic ability to accumulate and reuse experience across evolving task streams. In real-world environments such as interactive problem assistants or embodied agents, LLMs are required to handle continuous task streams, yet often fail to learn from accumulated interactions, losing valuable contextual insights, a limitation that calls for test-time evolution, where LLMs retrieve, integrate, and update memory continuously during deployment. To bridge this gap, we introduce Evo-Memory, a comprehensive streaming benchmark and framework for evaluating self-evolving memory in LLM agents. Evo-Memory structures datasets into sequential task streams, requiring LLMs to search, adapt, and evolve memory after each interaction. We unify and implement over ten representative memory modules and evaluate them across 10 diverse multi-turn goal-oriented and single-turn reasoning and QA datasets. To better benchmark experience reuse, we provide a baseline method, ExpRAG, for retrieving and utilizing prior experience, and further propose ReMem, an action-think-memory refine pipeline that tightly integrates reasoning, task actions, and memory updates to achieve continual improvement.

大模型记忆演化持续学习推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。