arXiv:2512.10696cs.AIcs.CL2025-12ACL被引 55

让智能体动态记忆并优化经验,实现更高效的学习进化。

Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution

论文配图:Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
图 1 · 摘自论文原文
  • 通过多维度提炼,从经验中挖掘成功模式与失败原因。
  • 在新任务中自动适配历史经验,提升记忆复用效率。
  • 自主更新记忆库,小模型用它可超越大模型表现。

程序化记忆使大型语言模型智能体能够内化‘如何做’的知识,理论上减少重复试错。然而,现有框架多采用‘被动积累’模式,将记忆视为静态追加的存档。为弥合静态存储与动态推理之间的差距,我们提出ReMe(Remember Me, Refine Me),一个面向经验驱动的智能体演化框架。ReMe在记忆生命周期中引入三项创新机制:1)多维提炼,通过识别成功模式、分析失败触发因素并生成对比洞察,提取细粒度经验;2)上下文自适应复用,基于场景感知索引,将历史见解适配至新情境;3)基于效用的精炼,自主添加有效记忆并剔除过时内容,保持经验池紧凑高质量。在BFCL-V3和AppWorld上的大量实验表明,ReMe建立了智能体记忆系统的最新标杆。关键发现:存在显著的记忆扩展效应——配备ReMe的Qwen3-8B性能优于无记忆的Qwen3-14B,表明自演化记忆为持续学习提供了高效的计算路径。代码与reme.library数据集已开源,以促进后续研究。

原文摘要 · Abstract (English)

Procedural memory enables large language model (LLM) agents to internalize "how-to" knowledge, theoretically reducing redundant trial-and-error. However, existing frameworks predominantly suffer from a "passive accumulation" paradigm, treating memory as a static append-only archive. To bridge the gap between static storage and dynamic reasoning, we propose $\textbf{ReMe}$ ($\textit{Remember Me, Refine Me}$), a comprehensive framework for experience-driven agent evolution. ReMe innovates across the memory lifecycle via three mechanisms: 1) $\textit{multi-faceted distillation}$, which extracts fine-grained experiences by recognizing success patterns, analyzing failure triggers and generating comparative insights; 2) $\textit{context-adaptive reuse}$, which tailors historical insights to new contexts via scenario-aware indexing; and 3) $\textit{utility-based refinement}$, which autonomously adds valid memories and prunes outdated ones to maintain a compact, high-quality experience pool. Extensive experiments on BFCL-V3 and AppWorld demonstrate that ReMe establishes a new state-of-the-art in agent memory system. Crucially, we observe a significant memory-scaling effect: Qwen3-8B equipped with ReMe outperforms larger, memoryless Qwen3-14B, suggesting that self-evolving memory provides a computation-efficient pathway for lifelong learning. We release our code and the $\texttt{reme.library}$ dataset to facilitate further research.

智能体记忆系统自我进化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。