给生成式推荐系统设计了概念遗忘新方法,解决敏感信息删除与推荐效果的冲突。
TRACER: Token ReAssignment for Concept ERasure in Generative Recommendation

- 通过重分配令牌,让需遗忘项避开共享标识符,减少对保留项影响
- 在真实数据集上实现目标概念有效清除,推荐性能损失更小
- 适合需要隐私保护的推荐场景,如医疗、金融领域
生成式推荐将下一物品预测建模为从用户历史交互中提取的语义ID(SID)序列上的自回归生成,使现代推荐系统在结构上类似大语言模型(LLMs)。随着隐私与安全问题加剧,系统需具备概念卸载能力,以移除与物品相关的敏感或有害概念。然而,现有LLM卸载方法无法直接应用于生成式推荐。不同于具有明确语义的词元,SID是抽象标识符,常被遗忘项和保留项共用,导致概念移除与推荐效用保持之间产生严重冲突。为此,我们提出TRACER,一种基于令牌重分配的端到端概念卸载框架。不直接抑制共享的SID,TRACER将相关项重新分配至更利于遗忘的替代令牌,同时最小化对保留项的副作用。我们进一步引入一致性正则化项,在卸载过程中保持保留项间的语义连贯性。在真实推荐数据集上的实验表明,TRACER能有效移除目标概念,且相比现有卸载基线显著更好保留推荐效用。
原文摘要 · Abstract (English)
Generative recommendation formulates next-item prediction as autoregressive generation over semantic ID (SID) sequences derived from users' historical interactions, making modern recommender systems structurally similar to large language models (LLMs). As privacy and safety concerns grow, these systems increasingly require concept unlearning to remove sensitive or harmful concepts associated with items. However, existing LLM unlearning methods cannot be directly applied to generative recommendation. Unlike word tokens with explicit semantics, SIDs are abstract identifiers that are often shared by both forget and retain items, leading to severe conflicts between concept removal and recommendation utility preservation. To address this challenge, we propose TRACER, an end-to-end concept unlearning framework based on token reassignment. Rather than directly suppressing shared SIDs, TRACER reassigns concept-related items to alternative tokens that better facilitate forgetting while minimizing side effects on retained items. We further introduce a coherence regularizer to preserve semantic consistency among retain items during unlearning. Experiments on real-world recommendation datasets demonstrate that TRACER effectively removes target concepts while substantially better preserving recommendation utility than existing unlearning baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。