让大模型自动管理记忆,既学得快又用得稳。
UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams

- 用可学习的路由令牌动态分配记忆路径,分存新任务与常用模式。
- 在三个模型上平均提升4.0点执行准确率,且无任务标签仍能扩展内存。
- 适合长期运行、任务流不断变化的大模型系统使用。
记忆对大语言模型智能体积累任务经验、复用特定执行策略至关重要。然而,在边界无关且持续演化的任务流中,存在稳定性与可塑性之间的根本矛盾。基于外部检索的记忆可快速吸收新信息,但难以内化重复的执行模式,且带来推理时的检索开销;参数化记忆虽稳定高效,却通常依赖明确的任务边界和固定参数预算。受人脑中情景记忆与渐进巩固机制的启发,我们提出UniMem,一种自路由的自主记忆管理框架。UniMem采用可学习的路由令牌作为记忆控制器,实现互补记忆路径的自适应协调:新奇或稀疏的任务保留在情景缓冲区以支持检索增强执行,而重复且可靠的模式则逐步固化到可扩展的参数化记忆中。通过将任务识别与执行解耦,利用路由令牌和参数化记忆模块,UniMem可在无需任务标签的部署过程中按需扩展内存,避免参数无控增长。在长时序流式任务序列上的实验表明,UniMem始终优于基线,同时保持执行保真度,在三种主干模型上平均获得4.0点EM提升。
原文摘要 · Abstract (English)
Memory is essential for LLM agents to accumulate task experience and reuse task-specific execution strategies. However, real-world deployment over boundary-agnostic and evolving task streams exposes a fundamental stability-plasticity dilemma. External retrieval-based memory can rapidly absorb new evidence, but it often fails to internalize recurring execution patterns and incurs inference-time retrieval overhead. Parametric memory enables stable and efficient execution once learned, but typically relies on explicit task boundaries and fixed parameter budgets. Inspired by the human brain, which balances plasticity and stability through complementary episodic storage and gradual consolidation, we propose UniMem, a self-routing framework for autonomous memory management. UniMem uses learnable routing tokens as memory controllers, enabling adaptive coordination between complementary memory pathways: novel or sparse tasks are retained in an episodic buffer for retrieval-augmented execution, while recurring and reliable patterns are consolidated into expandable parametric memory. By decoupling task identification from task execution with routing tokens and parametric memory blocks, UniMem expands memory on demand without task labels during deployment or uncontrolled parameter growth. Experiments on long-horizon streaming task sequences show that UniMem consistently outperforms baselines while maintaining execution fidelity, achieving an average gain of 4.0 EM points across three backbone models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。