将大模型推理压缩成可编辑的记忆模块,提升推荐系统效率与可解释性。
rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation
- 把大模型的推荐推理过程转化为四类可编辑的记忆通道
- 在多个数据集上相比基线最高提升13.3%的推荐准确率
- 支持记忆修改与辩论优化,适合需要可解释推荐的场景
大语言模型可通过显式推理用户历史和候选项目来提升推荐质量,但每次请求重复推理成本高,且结果一次性使用后即丢弃。本文提出rEDMRec,将教师模型的推理过程蒸馏为四种类型的可编辑经验通道:长期偏好、短期上下文、物品感知和反事实负样本对比,由一个大模型记忆控制器执行增删改查操作,并通过多代理辩论优化记忆内容。轻量级学生模型仅通过检索该记忆进行排序,无需再次调用教师模型,实现推理深度与在线开销解耦。在ML-1M、Amazon Beauty、Steam三个数据集上,十种学生骨干模型均优于零样本、少样本及RAG基线,且在多数骨干上超过GraphRAG,ML-1M上最高提升13.3%。消融实验显示,短期上下文在所有容量层级中持续有效,而长期偏好、物品感知和反事实贡献依赖于模型容量(强模型下甚至可能反向)。基于辩论的记忆优化使记忆冗余降低7.4个百分点,同时下游HR@1最高提升0.029,历经六轮优化。
原文摘要 · Abstract (English)
Large language models can improve recommendation quality by reasoning explicitly over user history and candidate items - for example, extracting a user's preferences or explaining why one item fits better than another - rather than mapping history directly to a ranked list. This reasoning, however, is expensive to repeat on every ranking request and, once produced, is typically consumed once and discarded, leaving it neither reusable across future requests nor easy to inspect or correct as user tastes drift. Our insight is that reasoning does not need to be regenerated at every call if it can instead be compressed once into a compact, structured memory that a lightweight model retrieves from. We propose rEDMRec, which distills a teacher LLM's reasoning into four typed, editable experience channels - long-term preference, short-term context, item-perception, and counterfactual hard-negative comparisons - maintained by an LLM memory controller that performs Add/Delete/Modify/Keep operations and refines entries via K-agent debate. A lightweight student LLM then ranks candidates purely by retrieving from this memory, without invoking the teacher again, decoupling online inference cost from reasoning depth. Across ML-1M, Amazon Beauty, and Steam and ten student backbones, rEDMRec improves HR@1 over zero-shot, few-shot, and RAG on every backbone, and over GraphRAG on most backbones, with Impv up to 13.3% vs. the second-best baseline on ML-1M. Channel ablations show that short-term context is the only channel that helps consistently across capacity tiers, whereas long-term, item-perception, and counterfactual contributions are capacity-dependent (and can reverse on the strongest students); debate-based memory optimization lowers bank duplication by 7.4 percentage points while raising downstream HR@1 by up to +0.029 over six optimization epochs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。