用向量记忆替代文本记忆,让推荐代理更高效地利用用户历史行为。
When Memory Takes Gradients: Collaborative Vector Memory for Agentic Recommender Systems

- 用冻结的LightGCN向量构建记忆库,通过候选集检索相关历史状态。
- 在4个基准上优于或持平最强文本记忆模型,且无需额外LLM调用维护记忆。
- 支持梯度更新,可训练记忆内容与读取方式,适合需要高效协同推荐的场景。
智能推荐系统将大语言模型(LLM)的每项决策基于用户的持久记忆,现有方法中该记忆为文本形式:由后续LLM调用生成和维护的叙述性记录。文本记忆存在两方面限制:更新需逐次重写,难以高效利用完整交互历史;协作性证据(如全目录的相似度评分)无法保留在句子中。我们提出CoVeMem(协作向量记忆),将代理记忆的核心转化为向量形式。冻结的LightGCN用户与物品状态构成记忆库;每次决策时,候选集自身检索最相关的过往状态,作为软令牌与轻量文本档案一同输入LLM上下文。通过对比对齐物品语义锚点,并结合掩码候选集进行列表级联合训练,模型学会读取这些状态并据此排序;点式是/否读出机制为每个候选打分。在四个指令驱动的推荐基准上,CoVeMem在20个指标单元中的19个上达到或超过最强协作文本记忆代理的表现,且除共享静态档案外,无需额外的LLM调用维护记忆,而文本记忆需针对每次交互调用。记忆现在可取梯度:以往无法触及的完整交互历史,成为训练代理记忆内容及读取方式的数据来源。
原文摘要 · Abstract (English)
Agentic recommender systems ground each decision of a large language model (LLM) in a persistent memory of the user, and in existing agents that memory is text: a narrative written and maintained by further LLM calls. Text limits this memory in two ways. It is updated one rewrite at a time, so exploiting the full interaction history is prohibitively expensive; and collaborative evidence, graded similarity over an entire catalog, does not survive translation into sentences. We propose CoVeMem (Collaborative Vector Memory), which vectorizes the collaborative core of the agent's memory. Frozen LightGCN user and item states form the memory bank; at each decision, the candidate set itself retrieves the most relevant historical states, which enter the LLM's context as soft tokens alongside a light textual profile. Contrastive alignment to item-semantic anchors, followed by listwise co-training with masked candidates, teaches the model to read these states and to rank through them; a pointwise yes/no readout scores each candidate. Across four instruction-grounded recommendation benchmarks, CoVeMem matches or exceeds the strongest collaborative text-memory agent on 19 of 20 metric cells while requiring zero additional LLM calls for memory maintenance beyond the shared static profile, against per-interaction calls for text memory. The memory now takes gradients: the full interaction history, out of reach for text, becomes available as training data for what the agent remembers and for how it reads what it remembers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。