提出新方法缓解持续删除数据时模型性能下降和遗忘倒退问题。
Robust Continual Unlearning against Knowledge Erosion and Forgetting Reversal

- 设计稳定保持保留数据表现的持续遗忘框架
- 有效抑制多轮删除中准确率下降与遗忘反转现象
- 适合需要频繁更新隐私数据的AI系统应用
为平衡人工智能产业发展与隐私保护需求,机器遗忘技术对实现人工智能中的“被遗忘权”至关重要。该技术可在保留其他知识的同时消除特定数据的影响。尽管已有广泛研究,但多数方法假设仅执行一次遗忘。本文在更现实的连续遗忘场景下评估现有算法,发现两个关键问题:(1) 知识侵蚀——保留数据准确率随遗忘轮次递减;(2) 遗忘反转——先前被遗忘的样本在后续轮次中重新可识别。为此,我们提出SAFER(StAbility-preserving Forgetting with Effective Regularization)框架,通过保持保留数据表示稳定性并施加负对数几率边界来强化遗忘数据的不可识别性。大量实验表明,SAFER不仅能缓解知识侵蚀,还能抑制遗忘反转,在多轮遗忘中实现稳定性能。
原文摘要 · Abstract (English)
As a means to balance the growth of the AI industry with the need for privacy protection, machine unlearning plays a crucial role in realizing the ``right to be forgotten'' in artificial intelligence. This technique enables AI systems to remove the influence of specific data while preserving the rest of the learned knowledge. Although it has been actively studied, most existing unlearning methods assume that unlearning is performed only once. In this work, we evaluate existing unlearning algorithms in a more realistic scenario where unlearning is conducted repeatedly, and in this setting, we identify two critical phenomena: (1) Knowledge Erosion, where the accuracy on retain data progressively degrades over unlearning phases, and (2) Forgetting Reversal, where previously forgotten samples become recognizable again in later phases. To address these challenges, we propose SAFER (StAbility-preserving Forgetting with Effective Regularization), a continual unlearning framework that maintains representation stability for retain data while enforcing negative logit margins for forget data. Extensive experiments show that SAFER mitigates not only knowledge erosion but also forgetting reversal, achieving stable performance across multiple unlearning phases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。