让对话记忆能预判未来需求,不只是靠关键词匹配。
T-Mem: Memory That Anticipates, Not Archives

- 记忆在写入时就预先生成多种检索触发器,支持表面和深层关联查找。
- 在LoCoMo和LoCoMo-Plus数据集上达到当前最优性能。
- 适合需要长期理解用户习惯的智能助手场景。
长时记忆对对话智能体保持连贯性、追踪跨会话承诺及个性化行为至关重要。现有基于大模型的长期对话记忆受限于查询与存储内容间的相似性(词汇或向量层面),仅在查询与记忆共享表面特征(如词语或实体)时有效(称作描述性)。但在无表面特征关联、仅依赖潜在语义联系(称为关联性)的情况下,现有系统普遍失效。为弥补这一空白,本文提出T-Mem,首个同时覆盖描述性与关联性召回的长期对话记忆架构。在单个事实和完整对话两个粒度上,T-Mem分别构建描述性与关联性触发器家族,使每条记忆都能通过表面相似或语义相关两种方式被检索。实证验证表明,T-Mem在LoCoMo与LoCoMo-Plus数据集上均达到当前最优表现。
原文摘要 · Abstract (English)
Long-term memory is essential for conversational agents to remain coherent across extended dialogues, follow through on commitments made many sessions earlier, and adapt their behaviour to each user. Current LLM-backed long-term conversational memory, however, is reachability-bounded by the similarity between a query and stored content, both lexical and dense-vector. The approach is effective when query and memory share surface features such as wording or named entities (we call this descriptive). But it misses another, equally valuable class of cases, where query and memory do not share surface features and are tied only by a latent semantic arc (associative). On this regime prevailing long-term memory systems collectively fail. Covering this other half is what allows an assistant, for the first time, to actively draw on past dialogue as a semantic asset. On the memory side, this is the engineering counterpart of what cognitive science calls episodic future thinking: rehearsing past experience for the future contexts under which it will need to be found. We call these write-time rehearsals triggers. We propose T-Mem, the first long-term conversational memory architecture that covers both descriptive and associative recall. At each of two evidence granularities, single facts and full exchanges, T-Mem instantiates one descriptive trigger family and one associative trigger family, so that every memory remains reachable from both surface-similar and relevance-bound queries. As empirical validation, T-Mem reaches state-of-the-art on both LoCoMo and LoCoMo-Plus.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。