提出稳定遗忘新框架,让模型安全删除数据不崩溃
CUFG: Curriculum Unlearning Guided by the Forgetting Gradient
- 用遗忘梯度指导修正优化,避免权重剧烈震荡
- 按从易到难顺序逐步遗忘,提升恢复效果接近重训练
- 适合需要可靠数据擦除的隐私保护场景
随着隐私与安全在人工智能中的重要性上升,机器遗忘——即从模型中移除特定知识的能力——受到越来越多关注。然而,现有方法过度追求效率和激进遗忘,带来显著局限:如梯度上升、影响函数或随机标签噪声等剧烈干预会破坏模型权重,导致性能崩溃和可靠性下降。为此,我们提出CUFG(基于遗忘梯度的课程遗忘),一种通过遗忘机制与数据调度策略创新来增强近似遗忘稳定性的新框架。具体而言,CUFG结合了由遗忘梯度引导的新型梯度修正器,用于基于微调的遗忘,并引入从易到难的课程遗忘范式,实现更稳定、渐进式的遗忘过程。该方法缩小了与理想重训练标准之间的差距,显著提升了遗忘的有效性与可靠性。大量实验证明了其在多种遗忘场景下的合理性与有效性。代码已公开于https://anonymous.4open.science/r/CUFG-6375。
原文摘要 · Abstract (English)
As privacy and security take center stage in AI, machine unlearning, the ability to erase specific knowledge from models, has garnered increasing attention. However, existing methods overly prioritize efficiency and aggressive forgetting, which introduces notable limitations. In particular, radical interventions like gradient ascent, influence functions, and random label noise can destabilize model weights, leading to collapse and reduced reliability. To address this, we propose CUFG (Curriculum Unlearning via Forgetting Gradients), a novel framework that enhances the stability of approximate unlearning through innovations in both forgetting mechanisms and data scheduling strategies. Specifically, CUFG integrates a new gradient corrector guided by forgetting gradients for fine-tuning-based unlearning and a curriculum unlearning paradigm that progressively forgets from easy to hard. These innovations narrow the gap with the gold-standard Retrain method by enabling more stable and progressive unlearning, thereby improving both effectiveness and reliability. Furthermore, we believe that the concept of curriculum unlearning has substantial research potential and offers forward-looking insights for the development of the MU field. Extensive experiments across various forgetting scenarios validate the rationale and effectiveness of our approach and CUFG. Codes are available at https://anonymous.4open.science/r/CUFG-6375.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。