arXiv:2605.21951cs.LG2026-05被引 2

让智能体持续学习不遗忘,用动态记忆模块实现自我进化。

Dynamic Mixture of Latent Memories for Self-Evolving Agents

论文配图:Dynamic Mixture of Latent Memories for Self-Evolving Agents
图 1 · 摘自论文原文
  • 用动态专家混合机制生成可注入的潜在记忆
  • 连续学习后平均准确率提升10.40%,优于基线模型
  • 适合需要长期积累知识的智能体系统

实现智能体的自我进化需在不断变化的任务序列中持续积累新知识,同时避免遗忘已有能力。现有方法或通过更新模型参数内化知识(导致灾难性遗忘),或依赖外部记忆(无法真正提升模型内在能力)。本文提出MoLEM,一种基于动态专家混合(MoE)的潜在记忆生成框架。将多个专家视为独立记忆载体,通过键-查询匹配选择并加权专家,聚合得到的潜在记忆注入推理过程。推理主模型始终保持冻结,所有经验知识由附加模块内化,有效避免灾难性遗忘。针对持续学习,每个训练阶段配备轻量级自编码器,在推理时选择合适的路由组,不匹配任何阶段的输入则回退至预训练模型。实验在数学、科学与编程领域连续学习序列上训练该框架,并在对应测试集上评估任务学习效果与能力保持情况。经过完整连续学习流程后,本方法相比基础预训练模型平均准确率提升10.40%,而所有对比方法在不同训练顺序下均未稳定超越该基线。

原文摘要 · Abstract (English)

Achieving self-evolution in intelligent agents requires the continual accumulation of new knowledge across changing task sequences without forgetting previously acquired abilities. Existing approaches either internalize knowledge by updating model parameters, which induces catastrophic forgetting, or rely on external memory, which fails to genuinely enhance the model's intrinsic capabilities. We propose MoLEM, a generative mixture of latent memory framework based on a dynamic mixture-of-experts (MoE). We treat multiple experts as independent carriers to generate memory. A router selects and weights experts through key-query matching, and the aggregated latent memory is injected into the reasoning process. The base model for reasoning remains entirely frozen, with all experiential knowledge internalized into the additional modules, avoiding catastrophic forgetting. For continual learning, each training stage is paired with a lightweight autoencoder that selects the appropriate routing group at inference, and inputs that match no stage fall back to the pretrained model. Experiments train the framework on continual-learning sequences spanning math, science, and code domains. After training, we evaluate the framework on the corresponding test sets to measure task learning and competence preservation across continual adaptation stages. After the full continual-learning sequence, our method improves the average accuracy by 10.40% over the Vanilla pretrained baseline, while none of the competing methods consistently exceed this baseline across different training orders.

持续学习记忆模块智能体动态路由

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。