让对话模型学会前瞻总结与后顾反思,长期记忆更准更懂你
In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents
- 通过前向总结与后向修正双机制,动态管理对话记忆
- 在LongMemEval上比基线高10%以上准确率
- 适合需要长期个性化的智能客服、聊天机器人场景
大语言模型在开放域对话中取得显著进展,但难以保留和检索长期交互中的相关信息,限制了其在需持续个性化应用中的表现。外部记忆机制被提出以解决此问题,使大语言模型能够保持对话连续性。然而,现有方法面临两大挑战:一是记忆粒度固定,无法捕捉对话的自然语义结构,导致表征碎片化;二是检索机制固定,无法适应多样对话场景和用户交互模式。本文提出反射式记忆管理(RMM),一种面向长期对话代理的新机制,融合前瞻与回溯反思:(1) 前瞻反思,动态地将不同粒度(话语、回合、会话)的交互信息总结为个性化记忆库,以支持未来高效检索;(2) 回溯反思,基于大语言模型引用证据,以在线强化学习方式迭代优化检索。实验表明,RMM在多个指标和基准上均表现一致提升,例如在LongMemEval数据集上,相比无记忆管理基线,准确率提升超过10%。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained personalization. External memory mechanisms have been proposed to address this limitation, enabling LLMs to maintain conversational continuity. However, existing approaches struggle with two key challenges. First, rigid memory granularity fails to capture the natural semantic structure of conversations, leading to fragmented and incomplete representations. Second, fixed retrieval mechanisms cannot adapt to diverse dialogue contexts and user interaction patterns. In this work, we propose Reflective Memory Management (RMM), a novel mechanism for long-term dialogue agents, integrating forward- and backward-looking reflections: (1) Prospective Reflection, which dynamically summarizes interactions across granularities-utterances, turns, and sessions-into a personalized memory bank for effective future retrieval, and (2) Retrospective Reflection, which iteratively refines the retrieval in an online reinforcement learning (RL) manner based on LLMs' cited evidence. Experiments show that RMM demonstrates consistent improvement across various metrics and benchmarks. For example, RMM shows more than 10% accuracy improvement over the baseline without memory management on the LongMemEval dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。