arXiv:2603.00638cs.IRcs.LG2026-03被引 1

用分区域增量编辑让大模型推荐系统持续适应用户变化。

RAIE: Region-Aware Incremental Preference Editing with LoRA for LLM-based Recommendation

  • 按语义把用户偏好分成区域,分别用LoRA小模型更新
  • 在两个数据集上显著优于现有方法且避免遗忘
  • 适合需要长期动态调整推荐的场景

大语言模型正被广泛用于推荐系统,但现实中的用户-物品交互具有非平稳性,导致偏好随时间漂移不可避免。现有模型更新策略依赖全局微调或逐点编辑,面临两大挑战:(i) 更新粒度失衡——全局更新扰动无关行为,而逐点编辑无法捕捉整体偏好变化;(ii) 增量更新不稳定——重复编辑会干扰先前适应,引发灾难性遗忘和推荐不一致。为此,我们提出区域感知增量编辑(RAIE),一种无需修改主模型的插件式框架。RAIE首先在表示空间中通过球面k均值构建语义连贯的偏好区域,再通过置信度感知门控将新序列分配至对应区域,并对受影响区域执行三种局部编辑操作:更新、扩展与新增。每个区域配备专用低秩适配器(LoRA),仅在该区域更新数据上训练。推理时,RAIE将用户序列路由至对应区域并激活专属适配器进行预测。在两个基准数据集上,采用时间切片协议(包含设置集S、微调集F和测试集T)的实验表明,RAIE显著优于当前最优基线,有效缓解遗忘问题。结果证明,区域感知编辑为动态推荐场景下的持续适应提供了准确且可扩展的机制。代码已开源:https://github.com/fengaogao/RAIE。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly adopted as the backbone of recommender systems. However, user-item interactions in real-world scenarios are non-stationary, making preference drift over time inevitable. Existing model update strategies mainly rely on global fine-tuning or pointwise editing, but they face two fundamental challenges: (i) imbalanced update granularity, where global updates perturb behaviors unrelated to the target while pointwise edits fail to capture broader preference shifts; (ii) unstable incremental updates, where repeated edits interfere with prior adaptations, leading to catastrophic forgetting and inconsistent recommendations. To address these issues, we propose Region-Aware Incremental Editing (RAIE), a plug-in framework that freezes the backbone model and performs region-level updates. RAIE first constructs semantically coherent preference regions via spherical k-means in the representation space. It then assigns incoming sequences to regions via confidence-aware gating and performs three localized edit operations - Update, Expand, and Add - to dynamically revise the affected region. Each region is equipped with a dedicated Low-Rank Adaptation (LoRA) module, which is trained only on the region's updated data. During inference, RAIE routes each user sequence to its corresponding region and activates the region-specific adapter for prediction. Experiments on two benchmark datasets under a time-sliced protocol that segments data into Set-up (S), Finetune (F), and Test (T) show that RAIE significantly outperforms state-of-the-art baselines while effectively mitigating forgetting. These results demonstrate that region-aware editing offers an accurate and scalable mechanism for continual adaptation in dynamic recommendation scenarios. Our code is available at https://github.com/fengaogao/RAIE.

推荐系统增量学习LoRA大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。