将记忆与推理分离,提升长序列推理能力
ActiveMem: Distributed Active Memory for Long-Horizon LLM Reasoning

- 用分层架构分离推理与记忆,避免上下文过载
- 在BrowseComp-Plus和GAIA上达到当前最优准确率
- 适合需要长期规划的智能体任务
记忆对大语言模型代理完成长时序推理任务至关重要。现有记忆机制多为集中式,将检索信息与交互历史统一存储于单一模型上下文中,导致扩展推理轨迹易引发上下文过载,而过度裁剪又可能造成不可逆信息丢失。受人类认知系统启发——前额叶皮层(执行控制)与海马体(记忆管理)功能互补,我们提出一种异构框架ActiveMem,将代理记忆从核心推理过程解耦。具体而言,高层规划器利用提炼的语义摘要执行推理,同时轻量级分布式记忆系统并行积累并巩固这些摘要。在BrowseComp-Plus和GAIA上的实验表明,ActiveMem以显著更低开销实现当前最优准确率,验证了分布式主动记忆在长时序推理中的有效性。
原文摘要 · Abstract (English)
Memory is essential for enabling large language model (LLM) agents to handle long-horizon reasoning tasks. Existing memory mechanisms are largely centralized, typically organizing retrieved information and interaction history within a single model context. This design imposes a fundamental trade-off: scaling reasoning trajectories risks context overload, whereas aggressive content pruning may result in irreversible information loss. Seeking a better trade-off, we draw inspiration from human cognitive systems, especially the functional complementarity between the prefrontal cortex (executive control) and the hippocampus (memory management), suggesting that such a trade-off need not be inherent, but may instead stem from centralized memory organization. To this end, we propose ActiveMem, a heterogeneous framework that decouples agent memory from the core reasoning process. Specifically, a high-level Planner utilizes distilled semantic gists to execute reasoning, while a lightweight, distributed memory system operates in parallel to actively accumulate and consolidate these gists throughout the task. Experiments on BrowseComp-Plus and GAIA show that ActiveMem achieves state-of-the-art accuracy with significantly reduced overhead, demonstrating the effectiveness of distributed active memory for long-horizon reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。