持续遗忘导致模型遗忘能力逐渐失效,影响长期隐私保护可靠性。
On the Plasticity Collapse in Continual Machine Unlearning

- 分析持续遗忘中参数空间的几何约束累积机制。
- 发现遗忘质量下降与已删数据意外重学两种失效模式。
- 适用于关注长期隐私安全的模型开发者与系统设计者。
机器遗忘使深度神经网络能够根据隐私和监管要求选择性消除特定数据的影响。尽管先前研究主要关注单次遗忘,现实系统必须支持持续遗忘,即多个遗忘请求随时间连续发生。本文揭示该场景下的根本限制:塑性崩溃,即模型逐步丧失有效遗忘能力。通过持续遗忘动态的理论分析,我们发现持续遗忘操作在参数空间中累积几何约束,导致饱和子空间,限制未来更新。这一结构效应引发两种失效模式:(1) 前向失败——后续任务遗忘质量下降;(2) 后向失败——意外重学此前已遗忘的信息。在多个架构、数据集和方法上的广泛实验表明,塑性崩溃并非特定实现的产物,而是持续遗忘固有的普遍现象。研究结果揭示了机器遗忘系统长期可靠性的关键障碍,并推动发展保持塑性的遗忘算法。代码开源于 https://github.com/TIML-Group/Continual-Machine-Unlearning-Plasticity-Collapse。
原文摘要 · Abstract (English)
Machine unlearning enables deep neural networks to selectively remove the influence of specific data in response to privacy and regulatory requirements. While prior work largely studies single-shot unlearning, real-world systems must accommodate continual unlearning, where multiple unlearning requests occur sequentially over time. In this work, we identify a fundamental limitation of this setting: plasticity collapse, a progressive breakdown in a model's ability to effectively forget. Through theoretical analysis of continual unlearning dynamics, we show that continual unlearning operations accumulate geometric constraints in parameter space, leading to saturated subspaces that restrict future updates. This structural effect induces two distinct failure modes: (1) Forward failure -- diminishing forgetting quality for subsequent tasks, and (2) Backward failure -- spontaneous re-memorization of previously forgotten information. Extensive experiments across multiple architectures, datasets, and methods in image classification confirm that plasticity collapse is not an artifact of specific implementations, but a pervasive phenomenon inherent to continual unlearning. Our findings reveal a critical barrier to the long-term reliability of machine unlearning systems and motivate the development of plasticity-preserving unlearning algorithms. Our code is available at https://github.com/TIML-Group/Continual-Machine-Unlearning-Plasticity-Collapse
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。