用分层记忆建模用户文本行为,实现更深度的个性化生成
MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generation
- 构建行为与认知双层记忆,融合时间与语义信息
- 在六个LaMP数据集上显著提升个性化生成效果
- 适合需要精准用户偏好建模的应用场景
用户与互联网的互动正从浏览、点击等隐式反馈,转向丰富的显式文本交互。这一转变带来了大量用户文本历史数据,为深度个性化提供了契机。然而现有方法仅将用户历史视为扁平文本列表,未能捕捉兴趣随时间演化的动态结构和语义关联。本文提出MemWeaver框架,将用户全部文本历史编织成分层记忆,以支持深度个性化生成。其核心是双组件记忆:行为记忆捕捉具体操作,认知记忆反映长期偏好,二者结合实现对用户具体行为与抽象特质的统一建模。该记忆结构使大语言模型能够推理用户的深层偏好,生成更契合其内在倾向的内容。在语言模型个性化(LaMP)基准的六个数据集上验证了有效性。代码已开源。
原文摘要 · Abstract (English)
The primary form of user-internet engagement is shifting from leveraging implicit feedback signals, such as browsing and clicks, to harnessing the rich explicit feedback provided by textual interactive behaviors. This shift unlocks a rich source of user textual history, presenting a profound opportunity for a deeper form of personalization. However, prevailing approaches offer only a shallow form of personalization, as they treat user history as a flat list of texts for retrieval and fail to model the rich temporal and semantic structures reflecting dynamic nature of user interests. In this work, we propose \textbf{MemWeaver}, a framework that weaves the user's entire textual history into a hierarchical memory to power deeply personalized generation. The core innovation of our memory lies in its ability to capture both the temporal evolution of interests and the semantic relationships between different activities. To achieve this, MemWeaver builds two complementary memory components that both integrate temporal and semantic information, but at different levels of abstraction: behavioral memory, which captures specific user actions, and cognitive memory, which represents long-term preferences. This dual-component memory serves as a comprehensive representation of the user, allowing large language models (LLMs) to reason over both concrete behaviors and abstracted cognitive traits. This leads to content generation that is deeply aligned with their latent preferences. Experiments on the six datasets of the Language Model Personalization (LaMP) benchmark validate the efficacy of MemWeaver. Our code is available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。