提出电路感知的遗忘机制,解决大模型推荐中隐私与性能的冲突。
CURE:Circuit-Aware Unlearning for LLM-based Recommendation
- 将模型拆解为功能不同的计算电路,针对性更新模块。
- 在真实数据集上实现更强的遗忘效果,且推荐性能下降更少。
- 适合关注隐私保护与模型可解释性的推荐系统研究者。
大语言模型(LLM)为推荐系统带来语义理解与推理能力,但用户数据引入隐私风险,亟需有效遗忘机制。现有方法将遗忘与保留统一优化,易引发梯度冲突,导致训练不稳定或性能严重退化,且过程缺乏透明性。为此,我们提出CURE框架,通过识别任务相关的计算子图(即‘电路’),分析各模块对遗忘与保留目标的贡献,将其分为遗忘特异、保留特异和任务共享三类,并施加对应更新规则,缓解梯度冲突。在真实数据集上的实验表明,该方法相比基线能实现更有效的遗忘,同时保持更高的模型实用性。
原文摘要 · Abstract (English)
Recent advances in large language models (LLMs) have opened new opportunities for recommender systems by enabling rich semantic understanding and reasoning about user interests and item attributes. However, as privacy regulations tighten, incorporating user data into LLM-based recommendation (LLMRec) introduces significant privacy risks, making unlearning algorithms increasingly crucial for practical deployment. Despite growing interest in LLMRec unlearning, most existing approaches formulate unlearning as a weighted combination of forgetting and retaining objectives while updating model parameters in a uniform manner. Such formulations inevitably induce gradient conflicts between the two objectives, leading to unstable optimization and resulting in either ineffective unlearning or severe degradation of model utility. Moreover, the unlearning procedure remains largely black-box, undermining its transparency and trustworthiness. To tackle these challenges, we propose CURE, a circuit-aware unlearning framework that disentangles model components into functionally distinct subsets and selectively updates them. Here, a circuit refers to a computational subgraph that is causally responsible for task-specific behaviors. Specifically, we extract the core circuits underlying item recommendation and analyze how individual modules within these circuits contribute to the forget and retain objectives. Based on this analysis, these modules are categorized into forget-specific, retain-specific, and task-shared groups, each subject to function-specific update rules to mitigate gradient conflicts during unlearning. Experiments on real-world datasets show that our approach achieves more effective unlearning than existing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。