用增量树结构让大模型智能体高效记忆,避免重复与冲突。
DELTAMEM: Incremental Experience Memory for LLM Agents via Residual Trees

- 将经验拆分为基础根节点和增量差值节点,减少冗余。
- 在多环境测试中,任务完成率比基线提升12%-18%。
- 适合需要长期学习的智能体研究者使用。
基于大语言模型的智能体日益依赖记忆来从持续交互中学习。然而,将经验以独立、扁平的方式存储会导致大量冗余和检索冲突,因为相似事件重复内容,细微场景变化会引发矛盾指导。为此,我们提出残差经验概念,认为新获取的经验往往是已有知识的增量变体。我们设计了DeltaMem框架,将经验记忆组织为两个独立的残差树:一个存储目标相关的任务经验作为可复用技能,另一个用于场景级环境知识。每棵树以根节点存放通用基础经验,通过增量差值节点记录后续变化,使相关经验共享同一基础而不重复。检索时采用失败惩罚的相似性扫描,通过根节点到匹配节点的路径组合重建完整经验。一种自主融合机制将高频路径提炼为新根节点,使树结构能从通用启发式逐步演化为专用变体。在多个交互环境中实验表明,DeltaMem始终优于现有基线。为促进未来研究,代码已开源:https://github.com/import-myself/DeltaMem。
原文摘要 · Abstract (English)
Large Language Model (LLM)-based agents increasingly rely on memory to learn from experiences over continual interactions. However, storing experiences as independent, flat units leads to substantial redundancy and retrieval conflicts, as similar episodes repeat overlapping content and subtle scene variations cause retrieved memories to offer contradictory guidance. To address this, we introduce residual experience, positing that newly acquired experience is often an incremental variation of existing knowledge. We propose DeltaMem, a framework that organizes experience memory into two independent residual trees, one storing goal-conditioned task experience as reusable skills and another for scene-level environment knowledge. Each tree uses a root node for generalized base experiences and incremental delta nodes for subsequent variations, allowing related experiences to share a common foundation without duplication. For retrieval, a failure-penalized similarity scan locates the best match, reconstructing the full experience via root-to-match chain composition. An autonomous consolidation mechanism distills high-frequency paths into new root nodes, enabling the trees to self-organize from general heuristics to specialized variants. Experiments across diverse interactive environments show that DeltaMem consistently outperforms existing baselines. To facilitate future research, we release the code at https://github.com/import-myself/DeltaMem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。