用大模型检索生成技术实现精准去偏删用户数据,不伤及他人推荐效果。
Customized Retrieval-Augmented Generation with LLM for Debiasing Recommendation Unlearning
- 分检索与生成两阶段,用定制策略精准定位目标用户数据影响。
- 在三个数据集上验证,去偏效果显著,推荐性能接近全量训练模型。
- 适合需要合规删除用户数据又不破坏系统公平性的推荐系统开发者。
现代推荐系统面临隐私法规(如‘被遗忘权’)的挑战:需移除某用户数据而不影响其他用户的推荐结果。传统去学习方法通过部分模型更新解决,但引入传播偏差——删除一个用户数据会扭曲行为相似用户的推荐,降低系统准确性。虽然重训可消除偏差,却在大规模系统中计算成本过高。为此,我们提出CRAGRU框架,利用检索增强生成(RAG)实现高效、用户定制的去学习,减轻偏差并保持推荐质量。CRAGRU将去学习拆分为独立的检索与生成阶段:检索阶段采用三种定制策略,精确隔离目标用户数据影响,最小化对无关用户的影响,提升去学习效率;生成阶段则使用大语言模型(LLM),结合用户画像嵌入提示词,重建准确且个性化的推荐,无需重训整个基础模型。在三个公开数据集上的实验表明,CRAGRU能有效去除指定用户数据,显著缓解去学习偏差,避免对非目标用户产生负面影响,同时保持与原全量训练模型相当的推荐性能。本工作凸显了基于RAG架构在构建鲁棒、隐私保护推荐系统中的潜力。源代码见:https://github.com/zhanghaichao520/LLM_rec_unlearning。
原文摘要 · Abstract (English)
Modern recommender systems face a critical challenge in complying with privacy regulations like the 'right to be forgotten': removing a user's data without disrupting recommendations for others. Traditional unlearning methods address this by partial model updates, but introduce propagation bias--where unlearning one user's data distorts recommendations for behaviorally similar users, degrading system accuracy. While retraining eliminates bias, it is computationally prohibitive for large-scale systems. To address this challenge, we propose CRAGRU, a novel framework leveraging Retrieval-Augmented Generation (RAG) for efficient, user-specific unlearning that mitigates bias while preserving recommendation quality. CRAGRU decouples unlearning into distinct retrieval and generation stages. In retrieval, we employ three tailored strategies designed to precisely isolate the target user's data influence, minimizing collateral impact on unrelated users and enhancing unlearning efficiency. Subsequently, the generation stage utilizes an LLM, augmented with user profiles integrated into prompts, to reconstruct accurate and personalized recommendations without needing to retrain the entire base model. Experiments on three public datasets demonstrate that CRAGRU effectively unlearns targeted user data, significantly mitigating unlearning bias by preventing adverse impacts on non-target users, while maintaining recommendation performance comparable to fully trained original models. Our work highlights the promise of RAG-based architectures for building robust and privacy-preserving recommender systems. The source code is available at: https://github.com/zhanghaichao520/LLM_rec_unlearning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。