让智能体自动设计记忆系统,实现持续学习。
Learning to Continually Learn via Meta-learning Agentic Memory Designs
- 用元学习自动搜索可执行代码形式的记忆结构
- 在4个决策任务中优于现有手工设计的记忆模块
- 适合研究自适应、可持续进化的AI系统的人
基础模型的无状态特性限制了智能体持续学习的能力,而持续学习是长期推理与适应的核心。当前智能体通常通过人工设计的固定记忆模块来保存经验,但这类设计难以适应真实世界任务的多样性和非平稳性。本文提出ALMA(面向智能体的记忆设计元学习框架),通过元智能体在开放空间中搜索以可执行代码表示的记忆设计,理论上可发现任意结构,包括数据库模式及其检索与更新机制。在四个顺序决策领域上的大量实验表明,所学记忆设计在所有基准上均比最先进的手工设计更高效、更有效。安全开发与部署后,ALMA为构建能自我改进的自适应持续学习智能体迈出了关键一步。
原文摘要 · Abstract (English)
The statelessness of foundation models bottlenecks agentic systems' ability to continually learn, a core capability for long-horizon reasoning and adaptation. To address this limitation, agentic systems commonly incorporate memory modules to retain and reuse past experience, aiming for continual learning during test time. However, most existing memory designs are human-crafted and fixed, which limits their ability to adapt to the diversity and non-stationarity of real-world tasks. In this paper, we introduce ALMA (Automated meta-Learning of Memory designs for Agentic systems), a framework that meta-learns memory designs to replace hand-engineered memory designs, therefore minimizing human effort and enabling agentic systems to be continual learners across diverse domains. Our approach employs a Meta Agent that searches over memory designs expressed as executable code in an open-ended manner, theoretically allowing the discovery of arbitrary memory designs, including database schemas as well as their retrieval and update mechanisms. Extensive experiments across four sequential decision-making domains demonstrate that the learned memory designs enable more effective and efficient learning from experience than state-of-the-art human-crafted memory designs on all benchmarks. When developed and deployed safely, ALMA represents a step toward self-improving AI systems that learn to be adaptive, continual learners.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。