让智能体的内存系统能自我进化,提升学习与泛化能力。
MemEvolve: Meta-Evolution of Agent Memory Systems
- 设计可自我演化的内存架构,与智能体同步优化。
- 在多个基准上性能提升最高达17.06%,跨任务泛化能力强。
- 开源统一代码库,支持多种内存系统的公平对比。
自演化内存系统正重塑基于大语言模型的智能体演化范式。以往工作多依赖人工设计的内存架构来存储轨迹、提炼经验并合成可复用工具,使智能体能在环境交互中动态演化。然而,该范式受限于内存系统的静态性:尽管智能体可进化,其底层内存架构却无法根据任务上下文进行元适应。为此,我们提出MemEvolve,一个联合演化智能体经验知识与内存架构的元演化框架,使智能体不仅能积累经验,还能持续优化学习方式。为衔接现有研究并推动未来自演化系统的开放性,我们引入EvolveLab,一个统一的自演化内存代码库,将十二种代表性内存系统抽象为模块化设计空间(编码、存储、检索、管理),提供标准化实现基底与公平实验平台。在四个挑战性智能体基准上的广泛评估表明,MemEvolve实现了显著性能提升,使SmolAgent和Flash-Searcher等框架性能最高提升17.06%;同时具备强跨任务与跨大模型泛化能力,设计出可在不同基准与主干模型间有效迁移的内存架构。
原文摘要 · Abstract (English)
Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill experience, and synthesize reusable tools, enabling agents to evolve on the fly within environment interactions. However, this paradigm is fundamentally constrained by the staticity of the memory system itself: while memory facilitates agent-level evolving, the underlying memory architecture cannot be meta-adapted to diverse task contexts. To address this gap, we propose MemEvolve, a meta-evolutionary framework that jointly evolves agents' experiential knowledge and their memory architecture, allowing agent systems not only to accumulate experience but also to progressively refine how they learn from it. To ground MemEvolve in prior research and foster openness in future self-evolving systems, we introduce EvolveLab, a unified self-evolving memory codebase that distills twelve representative memory systems into a modular design space (encode, store, retrieve, manage), providing both a standardized implementation substrate and a fair experimental arena. Extensive evaluations on four challenging agentic benchmarks demonstrate that MemEvolve achieves (I) substantial performance gains, improving frameworks such as SmolAgent and Flash-Searcher by up to $17.06\%$; and (II) strong cross-task and cross-LLM generalization, designing memory architectures that transfer effectively across diverse benchmarks and backbone models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。