让记忆系统自我进化,提升长程交互的准确性。
MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolution
- 用多智能体协同规划记忆构建与检索路径。
- 在记忆固化前自动修复失败,准确率提升12.7%。
- 适配多种大模型和存储后端,开箱即用。
增强记忆的大型语言模型代理通过外部记忆库支持长时程交互,但现有系统将记忆的构建、检索与利用视为孤立子程序,导致两个耦合问题:在记忆循环的前向路径中,因缺乏显式战略推理,构建与检索受局部启发式驱动;在反向路径中,下游失败极少直接转化为记忆库的修复。为此,我们提出MemMA,一种即插即用的多智能体框架,协同推进记忆循环的前后路径。前向路径中,元思考者生成结构化指引,指导记忆管理者进行构建,并引导查询推理者完成迭代检索。反向路径中,引入原位自演化记忆构建机制,合成探测问答对,验证当前记忆,并在记忆定稿前将失败转化为修复动作。在LoCoMo上的大量实验表明,MemMA在多个大模型基座上持续优于现有基线,且以即插即用方式提升三种不同存储后端的表现。代码已公开于https://github.com/ventr1c/memma。
原文摘要 · Abstract (English)
Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic blindness on the forward path of the memory cycle, where construction and retrieval are driven by local heuristics rather than explicit strategic reasoning, and sparse, delayed supervision on the backward path, where downstream failures rarely translate into direct repairs of the memory bank. To address these challenges, we propose MemMA, a plug-and-play multi-agent framework that coordinates the memory cycle along both the forward and backward paths. On the forward path, a Meta-Thinker produces structured guidance that steers a Memory Manager during construction and directs a Query Reasoner during iterative retrieval. On the backward path, MemMA introduces in-situ self-evolving memory construction, which synthesizes probe QA pairs, verifies the current memory, and converts failures into repair actions before the memory is finalized. Extensive experiments on LoCoMo show that MemMA consistently outperforms existing baselines across multiple LLM backbones and improves three different storage backends in a plug-and-play manner. Our code is publicly available at https://github.com/ventr1c/memma.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。