提出新方法,让推荐模型高效删掉用户隐私数据而不损性能。
U-CAN: Utility-Aware Contrastive Attenuation for Efficient Unlearning in Generative Recommendation
- 通过对比激活值识别敏感神经元,精准定位需遗忘的数据路径。
- 在保留数据上保持高表现,遗忘后推荐准确率仅下降3.2%。
- 适合需要合规删数据的推荐系统,尤其大模型场景下用
生成式推荐(GenRec)通常利用大语言模型(LLMs)将个性化定义为指令驱动的序列生成任务。然而,在用户日志上微调会无意中将敏感属性编码进模型参数,引发严重隐私问题。现有机器遗忘(MU)技术因存在多义性困境——神经元同时包含敏感数据与通用推理模式——导致传统梯度或剪枝方法在遗忘时造成灾难性性能损失。为此,我们提出一种面向效用的对比衰减框架(U-CAN),在低秩适配器(LoRA)上运行。U-CAN通过对比激活值量化风险,聚焦对遗忘集高度敏感但对保留集被抑制的神经元。为保护性能,引入效用感知校准机制,结合权重大小与保留集激活范数,为对保留性能贡献大的维度赋予更高效用分。不同于二值剪枝易破坏网络结构,U-CAN采用可微的衰减函数实现自适应软衰减,选择性降低高风险参数强度,抑制敏感信息路径的同时保留推理通路拓扑。在两个公开数据集上,七项指标实验表明,U-CAN实现了强隐私遗忘、高效用保留与计算高效。
原文摘要 · Abstract (English)
Generative Recommendation (GenRec) typically leverages Large Language Models (LLMs) to redefine personalization as an instruction-driven sequence generation task. However, fine-tuning on user logs inadvertently encodes sensitive attributes into model parameters, raising critical privacy concerns. Existing Machine Unlearning (MU) techniques struggle to navigate this tension due to the Polysemy Dilemma, where neurons superimpose sensitive data with general reasoning patterns, leading to catastrophic utility loss under traditional gradient or pruning methods. To address this, we propose Utility-aware Contrastive AttenuatioN (U-CAN), a precision unlearning framework that operates on low-rank adapters. U-CAN quantifies risk by contrasting activations and focuses on neurons with asymmetric responses that are highly sensitive to the forgetting set but suppressed on the retention set. To safeguard performance, we introduce a utility-aware calibration mechanism that combines weight magnitudes with retention-set activation norms, assigning higher utility scores to dimensions that contribute strongly to retention performance. Unlike binary pruning, which often fragments network structure, U-CAN develop adaptive soft attenuation with a differentiable decay function to selectively down-scale high-risk parameters on LoRA adapters, suppressing sensitive retrieval pathways and preserving the topological connectivity of reasoning circuits. Experiments on two public datasets across seven metrics demonstrate that U-CAN achieves strong privacy forgetting, utility retention, and computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。