通过语义段级整合,大幅降低大模型长期记忆的构建成本。
LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation

- 按语义段批量处理对话,减少LLM调用频率
- 在LoCoMo和LongMemEval-S上分别达到89.22%和92.20%准确率
- 相比A-Mem减少86%构建耗时,适合长程交互任务
长时程大模型智能体需保留过往交互信息以支持后续任务。现有记忆系统通常采用急切式整合,在每次交互后即调用LLM提取、摘要或更新记忆,导致随对话增长而成本飙升。粗略摘要虽可降低成本,但易丢失细粒度上下文证据;而扩大检索上下文或多跳推理则将开销转移至查询阶段。本文提出LycheeMemory V2,以语义段级整合替代逐轮整合。该方法将多个交互批处理为语义段,将每个完成的段落编码为与上下文无关的结构化记忆记录。语义边界检测有助于保持事件级和时间上的连贯性,优于固定窗口分块。记忆记录采用轻量级结构索引,支持计划式证据检索。实验表明,使用GPT-4.1-Mini,LycheeMemory在LoCoMo上达89.22%,在LongMemEval-S上达92.20%。相比A-Mem,LoCoMo上构建令牌数减少86.0%,LongMemEval-S上减少75.9%,且未增加查询阶段令牌消耗。结果表明,长期记忆的准确性与成本权衡不仅取决于保留信息,更取决于整合粒度。
原文摘要 · Abstract (English)
Long-horizon LLM agents must preserve information from past interactions to support future tasks. Existing memory systems typically rely on eager consolidation, invoking LLMs after each interaction to extract, summarize, or update memories. This design makes memory construction increasingly costly as conversations grow. Coarse summarization can reduce construction cost but risks discarding fine-grained contextual evidence, whereas larger retrieval contexts or multi-hop LLM reasoning shift the overhead to query time. We present LycheeMemory V2, an efficient long-term memory framework that replaces turn-level consolidation with semantic segment-level consolidation. Instead of consolidating every interaction, LycheeMemory batches multiple exchanges into segments and encodes each finalized segment into context-independent typed memory records. Segment-level batching lowers LLM encoding frequency, while semantic boundary detection helps preserve coherent event-level and temporal evidence compared with fixed-window batching. The resulting records are organized with lightweight structured indexes for query-planned evidence retrieval. Experiments using GPT-4.1-Mini show that LycheeMemory achieves state-of-the-art performance, reaching 89.22% on LoCoMo and 92.20% on LongMemEval-S. Compared with A-Mem, it reduces construction tokens by 86.0% on LoCoMo and 75.9% on LongMemEval-S without increasing query-time token usage. More broadly, our results suggest that the accuracy--cost trade-off of long-term agent memory depends not only on what information is retained, but also on the granularity at which it is consolidated.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。