让智能体像人一样不断积累经验并自我进化。
Memory Intelligence Agent

- 分层架构实现记忆管理、规划与执行协同。
- 测试时持续更新规划能力,推理不中断。
- 双向记忆转换提升效率,适合复杂任务场景。
深度研究智能体(DRAs)结合大模型推理与外部工具。记忆系统使智能体可利用历史经验,对高效推理和自主演化至关重要。现有方法依赖检索相似轨迹辅助推理,但存在记忆演化低效、存储与检索成本递增等问题。为此,我们提出新型记忆智能体(MIA)框架,采用经理-规划者-执行者架构。记忆经理为非参数化记忆系统,可压缩存储历史搜索轨迹;规划者为参数化记忆代理,生成问题的搜索计划;执行者则依据计划搜索并分析信息。通过交替强化学习提升规划者与执行者的协作。此外,规划者可在测试时学习中持续演化,边推理边更新,无需中断。建立参数与非参数记忆间的双向转换机制,实现高效记忆演化。最后引入反思与无监督判断机制,增强开放世界中的推理与自进化能力。在十一项基准测试中,MIA表现显著优于现有方法。
原文摘要 · Abstract (English)
Deep research agents (DRAs) integrate LLM reasoning with external tools. Memory systems enable DRAs to leverage historical experiences, which are essential for efficient reasoning and autonomous evolution. Existing methods rely on retrieving similar trajectories from memory to aid reasoning, while suffering from key limitations of ineffective memory evolution and increasing storage and retrieval costs. To address these problems, we propose a novel Memory Intelligence Agent (MIA) framework, consisting of a Manager-Planner-Executor architecture. Memory Manager is a non-parametric memory system that can store compressed historical search trajectories. Planner is a parametric memory agent that can produce search plans for questions. Executor is another agent that can search and analyze information guided by the search plan. To build the MIA framework, we first adopt an alternating reinforcement learning paradigm to enhance cooperation between the Planner and the Executor. Furthermore, we enable the Planner to continuously evolve during test-time learning, with updates performed on-the-fly alongside inference without interrupting the reasoning process. Additionally, we establish a bidirectional conversion loop between parametric and non-parametric memories to achieve efficient memory evolution. Finally, we incorporate a reflection and an unsupervised judgment mechanisms to boost reasoning and self-evolution in the open world. Extensive experiments across eleven benchmarks demonstrate the superiority of MIA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。