让智能体像人一样动态生成记忆,提升自我进化能力。
MemGen: Weaving Generative Latent Memory for Self-Evolving Agents
- 用触发器和编织器构建可生成的潜在记忆
- 在8个基准上超越现有系统最高38.22%
- 无需监督自动生成规划、程序等类人记忆
智能体记忆决定了大型语言模型驱动的智能体如何通过环境交互逐步自我优化,类似人类大脑。现有范式受限:参数化记忆强制调整模型参数,检索式记忆将经验外化为结构化数据库,但二者均未能捕捉人类认知中推理与记忆的动态交织。为此,我们提出MemGen,一种动态生成记忆框架,赋予智能体类人认知能力。它包含一个记忆触发器,监控推理状态以决定是否调用记忆;以及一个记忆编织器,以当前状态为刺激生成潜在标记序列作为机器原生记忆,增强推理过程。该机制使智能体在推理中持续回忆并扩充潜在记忆,形成记忆与认知紧密耦合的循环。在8个基准上的实验表明,MemGen相比领先外部记忆系统(如ExpeL和AWM)性能提升最高达38.22%,优于GRPO最高13.44%,且具备强跨领域泛化能力。更重要的是,无显式监督下,MemGen自发演化出类人记忆功能,包括计划记忆、程序记忆和工作记忆,暗示朝向更自然机器认知的涌现轨迹。
原文摘要 · Abstract (English)
Agent memory shapes how Large Language Model (LLM)-powered agents, akin to the human brain, progressively refine themselves through environment interactions. Existing paradigms remain constrained: parametric memory forcibly adjusts model parameters, and retrieval-based memory externalizes experience into structured databases, yet neither captures the fluid interweaving of reasoning and memory that underlies human cognition. To address this gap, we propose MemGen, a dynamic generative memory framework that equips agents with a human-esque cognitive faculty. It consists of a \textit{memory trigger}, which monitors the agent's reasoning state to decide explicit memory invocation, and a \textit{memory weaver}, which takes the agent's current state as stimulus to construct a latent token sequence as machine-native memory to enrich its reasoning. In this way, MemGen enables agents to recall and augment latent memory throughout reasoning, producing a tightly interwoven cycle of memory and cognition. Extensive experiments across eight benchmarks show that MemGen surpasses leading external memory systems such as ExpeL and AWM by up to $38.22\%$, exceeds GRPO by up to $13.44\%$, and exhibits strong cross-domain generalization ability. More importantly, we find that without explicit supervision, MemGen spontaneously evolves distinct human-like memory faculties, including planning memory, procedural memory, and working memory, suggesting an emergent trajectory toward more naturalistic forms of machine cognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。