用物理中的重整化群思想,让聊天机器人自动演化长期记忆。
RGMem: Renormalization Group-inspired Memory Evolution for Language Agents
- 借鉴重整化群思想,分层粗粒化处理对话,区分快速变化与慢速特质。
- 在LOCOMO和PersonaMem上超越现有方法,跨会话连续性更强。
- 适合需要长期个性化的智能客服、虚拟助手等场景。
个性化与持续交互对基于大语言模型的对话代理至关重要,但有限的上下文窗口和静态参数化记忆限制了对长期、跨会话用户状态的建模。现有方法如检索增强生成和显式记忆系统主要作用于事实层面,难以从动态且可能冲突的对话中提炼出稳定的偏好与深层用户特征。为此,我们提出RGMem,一种受重整化群(RG)多尺度组织与涌现视角启发的自演化记忆框架。RGMem将长期对话记忆建模为多尺度演化过程:情景化交互被转化为语义事实与用户洞察,再通过层级粗粒化、阈值更新与重缩放逐步整合,形成动态演化的用户画像。通过显式分离快速变化的证据与慢速变化的特质,并支持非线性、类似相变的动力学,RGMem实现了超越扁平检索或静态摘要的鲁棒个性化。在LOCOMO和PersonaMem基准上的大量实验表明,RGMem持续优于当前最优记忆系统,展现出更强的跨会话连续性与对演化用户偏好的适应能力。代码已公开于https://github.com/fenhg297/RGMem。
原文摘要 · Abstract (English)
Personalized and continuous interactions are critical for LLM-based conversational agents, yet finite context windows and static parametric memory hinder the modeling of long-term, cross-session user states. Existing approaches, including retrieval-augmented generation and explicit memory systems, primarily operate at the fact level, making it difficult to distill stable preferences and deep user traits from evolving and potentially conflicting dialogues.To address this challenge, we propose RGMem, a self-evolving memory framework inspired by the renormalization group (RG) perspective on multi-scale organization and emergence. RGMem models long-term conversational memory as a multi-scale evolutionary process: episodic interactions are transformed into semantic facts and user insights, which are then progressively integrated through hierarchical coarse-graining, thresholded updates, and rescaling into a dynamically evolving user profile.By explicitly separating fast-changing evidence from slow-varying traits and enabling non-linear, phase-transition-like dynamics, RGMem enables robust personalization beyond flat retrieval or static summarization. Extensive experiments on the LOCOMO and PersonaMem benchmarks demonstrate that RGMem consistently outperforms SOTA memory systems, achieving stronger cross-session continuity and improved adaptation to evolving user preferences. Code is available at https://github.com/fenhg297/RGMem
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。