让大模型长期记忆更高效,减少冗余并大幅降低推理开销。
SimpleMem: Efficient Lifelong Memory for LLM Agents
- 三阶段压缩框架:结构化提取、实时融合、意图驱动检索。
- 在LoCoMo数据集上提升26.4%准确率,推理耗 token 降低30倍。
- 适合需要长期交互的智能体系统,如对话机器人、自主代理。
为支持复杂环境中的长期交互,大模型智能体需要能管理历史经验的记忆系统。现有方法或通过被动扩展上下文保留完整交互历史,导致大量冗余;或依赖迭代推理过滤噪声,造成高昂的 token 消耗。为此,我们提出 SimpleMem,一种基于语义无损压缩的高效记忆框架。设计了三阶段流程:(1) 语义结构压缩,将非结构化交互浓缩为紧凑的多视角索引记忆单元;(2) 在线语义合成,会话内即时整合相关上下文,生成统一抽象表示以消除冗余;(3) 意图感知检索规划,推断搜索意图,动态确定检索范围并高效构建精确上下文。基准测试表明,该方法在准确性、检索效率和推理成本上均优于基线,于 LoCoMo 数据集上平均 F1 提升 26.4%,推理时 token 消耗最高降低 30 倍,实现性能与效率的优异平衡。代码已开源:https://github.com/aiming-lab/SimpleMem。
原文摘要 · Abstract (English)
To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to substantial redundancy, or rely on iterative reasoning to filter noise, incurring high token costs. To address this challenge, we introduce SimpleMem, an efficient memory framework based on semantic lossless compression. We propose a three-stage pipeline designed to maximize information density and token utilization: (1) Semantic Structured Compression, which distills unstructured interactions into compact, multi-view indexed memory units; (2) Online Semantic Synthesis, an intra-session process that instantly integrates related context into unified abstract representations to eliminate redundancy; and (3) Intent-Aware Retrieval Planning, which infers search intent to dynamically determine retrieval scope and construct precise context efficiently. Experiments on benchmark datasets show that our method consistently outperforms baseline approaches in accuracy, retrieval efficiency, and inference cost, achieving an average F1 improvement of 26.4% in LoCoMo while reducing inference-time token consumption by up to 30-fold, demonstrating a superior balance between performance and efficiency. Code is available at https://github.com/aiming-lab/SimpleMem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。