arXiv:2511.16414cs.IR2025-11

提出高效演化推荐框架,解决大模型推荐系统更新难题。

An Efficient LLM-based Evolutional Recommendation with Locate-Forget-Update Paradigm

  • 通过定位-遗忘-更新机制,只更新30%的参数以适应用户偏好变化。
  • 相比传统方法,计算成本更低且能保留不活跃用户的兴趣。
  • 适合需要持续更新推荐模型的电商平台使用。

当前大型语言模型(LLM)在序列推荐中表现优异,越来越多电商平台采用基于LLM的推荐系统(LLMRec)。然而,海量的新用户-物品交互使模型难以随时间演变用户偏好,尤其对参数庞大的LLM而言,传统方法(如重训练或微调)不可行。重训练需全量数据,计算开销巨大;仅用新数据微调则导致不活跃用户兴趣被遗忘,影响整体性能。为此,本文提出EvoRec,一种面向LLM推荐系统的高效定位-遗忘-更新框架,精准识别并更新与偏好变化相关的少量参数,显著降低资源消耗。实验表明,该方法仅修改LoRA适配器参数的30%,未引入额外参数,在两个真实数据集上均实现更优的推荐效果,既能有效适应活跃用户偏好,又能避免干扰不活跃用户的历史兴趣。

原文摘要 · Abstract (English)

Nowadays, Large Language Models (LLMs) have shown exceptional performance in sequential recommendations, and the adoption of LLM-based recommender systems (LLMRec) is becoming increasingly widespread in existing e-commerce platforms. Despite the impressive performance, the constant high volume of new user-item interactions makes it difficult to adapt to the evolution of user preference over time, especially for LLM-based recommender systems. The challenge arises from the large number of parameters in LLMs, which makes traditional evolution methods (i.e., Re-training or Fine-tuning) impractical. Specifically, Re-training with all interactions results in prohibitively high computational costs. On the other hand, fine-tuning with only new interactions leads to preference forgetting among inactive users, ultimately compromising overall performance. To tackle this problem, we propose EvoRec, an efficient Locate-Forget-Update framework designed for LLM-based recommender systems to model the evolution of user preferences. EvoRec identifies a small set of parameters associated with preference changes and updates them precisely, thereby saving computational resources while maintaining strong recommendation performance. Notably, the modified parameters account for only 30\% of LoRA adapter parameters, with no additional parameters introduced. Extensive experiments on two real-world datasets demonstrate that, compared to existing methods, EvoRec not only efficiently evolves LLMRec to adapt to the preferences of active users, but also preserves the interests of inactive users from being disturbed during evolution.

推荐系统大模型演化学习参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。