arXiv:2502.05589cs.CLcs.AI2025-02ICLR被引 101

提出分段记忆构建方法,提升长对话个性化生成效果

On Memory Construction and Retrieval for Personalized Conversational Agents

论文配图:On Memory Construction and Retrieval for Personalized Conversational Agents
图 1 · 摘自论文原文
  • 按话题分段构建记忆单元,替代原有粒度划分
  • 在LOCOMO和Long-MT-Bench+上显著优于基线模型
  • 结合提示压缩去噪,适合长时对话系统开发者

为实现长期对话中的连贯与个性化体验,现有方法通常基于对话历史构建记忆库,采用话语级、会话级或摘要式方法。本文发现:(1)记忆单元粒度影响明显,三类方法在检索准确率与语义质量上均存在局限;(2)如LLMLingua-2等提示压缩技术可有效充当去噪机制,提升不同粒度下的检索性能。基于此,我们提出SeCom方法,通过引入对话分段模型将长期对话划分为语义连贯的片段,并对记忆单元应用压缩去噪以增强检索能力。实验表明,SeCom在长期对话基准数据集LOCOMO和Long-MT-Bench+上显著优于基线模型;所提对话分段方法在DialSeg711、TIAGE和SuperDialSeg数据集上也表现优异。

原文摘要 · Abstract (English)

To deliver coherent and personalized experiences in long-term conversations, existing approaches typically perform retrieval augmented response generation by constructing memory banks from conversation history at either the turn-level, session-level, or through summarization techniques.In this paper, we present two key findings: (1) The granularity of memory unit matters: turn-level, session-level, and summarization-based methods each exhibit limitations in both memory retrieval accuracy and the semantic quality of the retrieved content. (2) Prompt compression methods, such as LLMLingua-2, can effectively serve as a denoising mechanism, enhancing memory retrieval accuracy across different granularities. Building on these insights, we propose SeCom, a method that constructs the memory bank at segment level by introducing a conversation segmentation model that partitions long-term conversations into topically coherent segments, while applying compression based denoising on memory units to enhance memory retrieval. Experimental results show that SeCom exhibits a significant performance advantage over baselines on long-term conversation benchmarks LOCOMO and Long-MT-Bench+. Additionally, the proposed conversation segmentation method demonstrates superior performance on dialogue segmentation datasets such as DialSeg711, TIAGE, and SuperDialSeg.

对话系统记忆构建长程对话分段处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。