提出新方法让推荐系统快速删掉用户数据,不重训也能保持效果。
Pre-training for Recommendation Unlearning
- 用影响编码器直接生成删除数据后的模型参数,无需重训练。
- 在公开数据集上实现10倍以上速度提升,性能几乎不变。
- 适合需要快速响应数据删除请求的推荐系统应用。
基于图神经网络的现代推荐系统虽能有效建模复杂用户-物品交互,但日益面临选择性遗忘训练数据的需求。除了用户因隐私或偏好变化要求删除特定交互外,监管框架也要求推荐系统具备消除特定用户数据影响的能力。这一推荐遗忘挑战具有独特困难:在交互图中移除连接会引发模型内部的连锁反应,可能影响大量用户的推荐结果。传统方法存在明显缺陷:碎片化方法破坏图结构并降低性能,而影响函数技术依赖的假设在复杂的GNN中(尤其是自监督或随机架构)可能不成立。为此,我们提出一种新型、模型无关的预训练范式UnlearnRec,为高效遗忘操作做好准备。我们的影响编码器接收遗忘请求和现有模型参数,直接生成已遗忘模型的更新参数,仅需少量微调,避免完全重训同时保留模型性能特征。在公开基准上的广泛评估表明,该方法在实现卓越遗忘效果的同时,相比重训方法提速超过10倍。代码已开源:https://github.com/HKUDS/UnlearnRec。
原文摘要 · Abstract (English)
Modern recommender systems powered by Graph Neural Networks (GNNs) excel at modeling complex user-item interactions, yet increasingly face scenarios requiring selective forgetting of training data. Beyond user requests to remove specific interactions due to privacy concerns or preference changes, regulatory frameworks mandate recommender systems' ability to eliminate the influence of certain user data from models. This recommendation unlearning challenge presents unique difficulties as removing connections within interaction graphs creates ripple effects throughout the model, potentially impacting recommendations for numerous users. Traditional approaches suffer from significant drawbacks: fragmentation methods damage graph structure and diminish performance, while influence function techniques make assumptions that may not hold in complex GNNs, particularly with self-supervised or random architectures. To address these limitations, we propose a novel model-agnostic pre-training paradigm UnlearnRec that prepares systems for efficient unlearning operations. Our Influence Encoder takes unlearning requests together with existing model parameters and directly produces updated parameters of unlearned model with little fine-tuning, avoiding complete retraining while preserving model performance characteristics. Extensive evaluation on public benchmarks demonstrates that our method delivers exceptional unlearning effectiveness while providing more than 10x speedup compared to retraining approaches. We release our method implementation at: https://github.com/HKUDS/UnlearnRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。