arXiv:2508.15263cs.IR2025-08

提出课程式近似删除框架,让推荐系统高效删掉特定用户行为而不降性能。

Curriculum Approximate Unlearning for Session-based Recommendation

  • 用多目标优化平衡删样与性能保留,避免推荐效果下降。
  • 按难易程度排序删样,先易后难,提升删除效率和准确性。
  • 适合需要隐私保护或动态更新的会话推荐场景。

会话推荐中的近似删除旨在不重新训练模型的情况下消除特定训练样本的影响。梯度上升(GA)是代表性方法,但在会话推荐中面临双重挑战:一是直接应用GA会导致推荐性能下降;二是现有方法未考虑多个删除请求的处理顺序,影响效果。为此,本文提出针对会话推荐的课程式近似删除框架CAU。CAU通过在删除样本上引入GA项实现删除任务。为解决第一挑战,将整体优化问题建模为多目标问题,将删除项与性能保持项结合,通过寻找帕累托最优解,在极小损失性能的前提下实现有效删除。为应对第二挑战,采用基于课程学习的样本处理序列,从易到难进行删除。为此引入梯度删除难度和嵌入删除难度两个度量指标,并设计硬采样与软采样策略,依据难度分数选择删除样本。

原文摘要 · Abstract (English)

Approximate unlearning for session-based recommendation refers to eliminating the influence of specific training samples from the recommender without retraining of (sub-)models. Gradient ascent (GA) is a representative method to conduct approximate unlearning. However, there still exist dual challenges to apply GA for session-based recommendation. On the one hand, naive applying of GA could lead to degradation of recommendation performance. On the other hand, existing studies fail to consider the ordering of unlearning samples when simultaneously processing multiple unlearning requests, leading to sub-optimal recommendation performance and unlearning effect. To address the above challenges, we introduce CAU, a curriculum approximate unlearning framework tailored to session-based recommendation. CAU handles the unlearning task with a GA term on unlearning samples. Specifically, to address the first challenge, CAU formulates the overall optimization task as a multi-objective optimization problem, where the GA term for unlearning samples is combined with retaining terms for preserving performance. The multi-objective optimization problem is solved through seeking the Pareto-Optimal solution, which achieves effective unlearning with trivial sacrifice on recommendation performance. To tackle the second challenge, CAU adopts a curriculum-based sequence to conduct unlearning on batches of unlearning samples. The key motivation is to perform unlearning from easy samples to harder ones. To this end, CAU first introduces two metrics to measure the unlearning difficulty, including gradient unlearning difficulty and embedding unlearning difficulty. Then, two strategies, hard-sampling and soft-sampling, are proposed to select unlearning samples according to difficulty scores.

会话推荐近似删除多目标优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。