根据用户偏好变化动态选择记忆,提升长对话系统表现。
Memory Retrieval for Changing Preferences

- 用贝叶斯因子衡量每段记忆的证据价值,指导何时用、用哪部分。
- 在4个不同数据集上优于现有基于嵌入的检索方法,尤其在偏好变化场景。
- 适合需要捕捉用户兴趣演变的对话系统研究者使用。
长上下文对话系统需决定何时访问记忆以及哪些历史交互内容相关。现有方法通常依赖启发式检索信号或始终开启记忆使用,未能考虑用户偏好随时间变化且可能不一致的问题。本文提出一种基于偏好变化的统一记忆访问与选择框架。将个性化记忆检索建模为识别哪些历史回合能提供关于用户潜在偏好状态的证据,而非依赖表面语义相似性。为此,我们使用贝叶斯因子量化每段记忆的效用,即包含该回合时模型对参考回复的似然提升程度。这提供了一个严谨的证据强度度量,并统一用于记忆访问与选择。通过将记忆检索视为效用估计,模型学会识别关键回合并根据预期效用调节记忆使用。在四个异构记忆基准上的实验表明,本方法在长上下文、偏好密集型任务中优于现有嵌入式检索方法,而在低密度场景下仍具竞争力。
原文摘要 · Abstract (English)
Long-context dialogue systems must decide both when to access memory and which parts of the interaction history are relevant. Existing approaches typically rely on heuristic retrieval signals or always-on memory usage, failing to account for the changing and potentially inconsistent nature of user preferences. In this work, we propose a unified framework for memory access and selection based on changing preferences. We formulate personalized memory retrieval as identifying which historical turns provide evidence about a user's latent preference state, rather than relying on surface-level semantic similarity. To this end, we quantify the utility of each memory turn using a Bayes factor, defined as the improvement in the model's likelihood of the reference response when the turn is included in context. This provides a principled measure of evidence strength and a unified signal for both memory access and selection. By framing memory retrieval as utility estimation, the model learns to identify salient turns and regulate memory usage based on expected utility. Experiments on four heterogeneous memory benchmarks show that our approach outperforms existing embedding-based retrieval on long-context, preference-intensive tasks where modeling changing preferences is essential, while remaining competitive in low-density regimes where semantic similarity suffices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。