让大模型记忆技能可学可进化,自动优化记忆提取与更新方式。
MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agents

- 将记忆操作设计为可学习的技能,由控制器动态选择。
- 在多个数据集上超越基线,长序列任务性能提升显著。
- 支持自我演化,适合长期交互的智能体系统开发。
大多数大型语言模型(LLM)代理的记忆系统依赖少量静态的手动设计操作来提取记忆。这些固定流程硬编码了人类对存储内容和记忆修订方式的先验知识,导致在多样化交互模式下表现僵化,并在处理长历史记录时效率低下。为此,我们提出 extbf{MemSkill},将这些操作重构为可学习且可演化的记忆技能,即结构化、可复用的信息提取、整合与修剪流程。受代理技能设计哲学启发,MemSkill 采用一个学习技能选择的 extit{控制器},搭配基于 LLM 的 extit{执行器} 生成技能引导的记忆。除了学习技能选择外,MemSkill 还引入一个 extit{设计师},定期审查因技能选择不当导致错误或不完整记忆的困难案例,并通过提出改进方案与新技能来演化技能集。由此形成闭环过程,持续优化技能选择策略与技能集合本身。在 LoCoMo、LongMemEval、HotpotQA 与 ALFWorld 上的实验表明,MemSkill 在多项任务中优于强基线,并展现出良好的跨场景泛化能力。进一步分析揭示了技能的演化机制,为构建更自适应、自演化的 LLM 代理记忆管理提供了洞见。
原文摘要 · Abstract (English)
Most Large Language Model (LLM) agent memory systems rely on a small set of static, hand-designed operations for extracting memory. These fixed procedures hard-code human priors about what to store and how to revise memory, making them rigid under diverse interaction patterns and inefficient on long histories. To this end, we present \textbf{MemSkill}, which reframes these operations as learnable and evolvable memory skills, structured and reusable routines for extracting, consolidating, and pruning information from interaction traces. Inspired by the design philosophy of agent skills, MemSkill employs a \emph{controller} that learns to select a small set of relevant skills, paired with an LLM-based \emph{executor} that produces skill-guided memories. Beyond learning skill selection, MemSkill introduces a \emph{designer} that periodically reviews hard cases where selected skills yield incorrect or incomplete memories, and evolves the skill set by proposing refinements and new skills. Together, MemSkill forms a closed-loop procedure that improves both the skill-selection policy and the skill set itself. Experiments on LoCoMo, LongMemEval, HotpotQA, and ALFWorld demonstrate that MemSkill improves task performance over strong baselines and generalizes well across settings. Further analyses shed light on how skills evolve, offering insights toward more adaptive, self-evolving memory management for LLM agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。