用事件级结构记忆,让大模型对话更连贯持久。
A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agents
- 将对话拆成带实体和时间线索的事件单元,构建异构图存储。
- 在两个长对话评估集上表现超越基线,且问答上下文更短。
- 适合需要长期记忆的对话系统研发者参考使用。
基于大语言模型的对话智能体在跨多轮会话中仍难以保持连贯与个性化:固定上下文窗口限制了历史信息的保留量,而多数外部记忆方法在粗粒度检索与细粒度碎片化之间权衡。受新大卫森事件语义学启发,我们提出一种以事件为中心的替代方案,将对话历史表示为短小、类事件的命题,整合参与者、时间线索及最小局部上下文,而非独立的关系三元组或模糊摘要。与激进压缩或遗忘过往内容的方法不同,本设计旨在非压缩形式下保存信息并提升可访问性。具体而言,我们指导大模型将每轮会话分解为丰富化的基本话语单元(EDUs)——包含归一化实体与来源回合归属的自包含陈述,并在会话、EDU及其论元间构建异构图以支持关联召回。在此表示基础上,构建两种基于检索的变体:采用密集相似性搜索与大模型过滤,并可选加入图传播步骤以连接和聚合相关EDU的证据。在LoCoMo与LongMemEval$_S$基准上的实验表明,这些事件级记忆达到或超过强基线性能,同时使用显著更短的问答上下文。结果表明,结构简单的事件级记忆为长时对话智能体提供了原则性且实用的基础。代码与数据将于https://github.com/KevinSRR/EMem发布。
原文摘要 · Abstract (English)
LLM-based conversational agents still struggle to maintain coherent, personalized interaction over many sessions: fixed context windows limit how much history can be kept in view, and most external memory approaches trade off between coarse retrieval over large chunks and fine-grained but fragmented views of the dialogue. Motivated by neo-Davidsonian event semantics, we propose an event-centric alternative that represents conversational history as short, event-like propositions which bundle together participants, temporal cues, and minimal local context, rather than as independent relation triples or opaque summaries. In contrast to work that aggressively compresses or forgets past content, our design aims to preserve information in a non-compressive form and make it more accessible, rather than more lossy. Concretely, we instruct an LLM to decompose each session into enriched elementary discourse units (EDUs) -- self-contained statements with normalized entities and source turn attributions -- and organize sessions, EDUs, and their arguments in a heterogeneous graph that supports associative recall. On top of this representation we build two simple retrieval-based variants that use dense similarity search and LLM filtering, with an optional graph-based propagation step to connect and aggregate evidence across related EDUs. Experiments on the LoCoMo and LongMemEval$_S$ benchmarks show that these event-centric memories match or surpass strong baselines, while operating with much shorter QA contexts. Our results suggest that structurally simple, event-level memory provides a principled and practical foundation for long-horizon conversational agents. Our code and data will be released at https://github.com/KevinSRR/EMem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。