用分层摘要+大模型判断,让对话记忆更准更省。
HiGMem: A Hierarchical and LLM-Guided Memory System for Long-Term Conversational Agents

- 分两层存储:先看事件摘要,再选相关对话轮次。
- 在LoCoMo10上比A-Mem高0.24的对抗性F1,召回轮次少十倍。
- 适合需要长期记忆的对话系统,尤其关注效率与可解释性。
长期对话型大语言模型代理需要能够从历史交互中恢复相关证据,又不使回答阶段被无关上下文淹没。然而现有记忆系统(包括分层系统)仍主要依赖向量相似性检索,常导致证据集臃肿:添加大量表面相似的对话轮次,仅轻微提升召回率,却显著降低精度,增加回答阶段上下文开销,并使检索结果难以检查和管理。为此,我们提出HiGMem(分层且大模型引导的记忆系统),一种两级事件-轮次记忆架构,允许大模型以事件摘要为语义锚点,预测哪些相关轮次值得阅读。这使模型能先审视高层事件摘要,再聚焦于一组潜在有用轮次,通过推理生成简洁可靠的证据集,避免与向量检索相比过高的检索开销。在LoCoMo10基准测试中,HiGMem在五个问题类别中的四个达到最优F1,对抗性F1从0.54提升至0.78,同时检索轮次数减少一个数量级。代码已公开于https://github.com/ZeroLoss-Lab/HiGMem。
原文摘要 · Abstract (English)
Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory systems, including hierarchical ones, still often rely solely on vector similarity for retrieval. It tends to produce bloated evidence sets: adding many superficially similar dialogue turns yields little additional recall, but lowers retrieval precision, increases answer-stage context cost, and makes retrieved memories harder to inspect and manage. To address this, we propose HiGMem (Hierarchical and LLM-Guided Memory System), a two-level event-turn memory system that allows LLMs to use event summaries as semantic anchors to predict which related turns are worth reading. This allows the model to inspect high-level event summaries first and then focus on a smaller set of potentially useful turns, providing a concise and reliable evidence set through reasoning, while avoiding the retrieval overhead that would be excessively high compared to vector retrieval. On the LoCoMo10 benchmark, HiGMem achieves the best F1 on four of five question categories and improves adversarial F1 from 0.54 to 0.78 over A-Mem, while retrieving an order of magnitude fewer turns. Code is publicly available at https://github.com/ZeroLoss-Lab/HiGMem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。