arXiv:2602.05375cs.LGcs.CV2026-02被引 1

提出新框架,让模型彻底遗忘数据,连内部表示都清空。

Erase at the Core: Representation Unlearning for Machine Unlearning

  • 在中间层引入对比学习,强制清除遗忘数据的特征表示。
  • 实验显示,模型对遗忘数据的准确率接近零,且特征相似度大幅降低。
  • 可无缝接入现有方法,适合需要深度隐私保护的场景。

许多近似机器遗忘方法虽在输出层实现强遗忘(如遗忘集上准确率接近零),但其内部特征表示仍保留大量原始信息,这种现象称为表面遗忘。现有方法主要修改最终分类器,中间层表示与原模型高度相似。为此,我们提出核心擦除(Erase at the Core, EC)框架,通过多层对比遗忘与深层监督学习,在整个网络层级中强制遗忘。EC在中间层附加辅助模块,于各监督点同时施加对比遗忘损失和交叉熵损失,并采用分层加权策略。实验表明,EC不仅实现有效的输出层遗忘,还显著降低中间层特征表示与原模型的相似性。此外,EC具备模型无关性,可作为插件集成到现有遗忘方法中,在保持保留集性能的同时提升表示层面的遗忘效果。

原文摘要 · Abstract (English)

Many approximate machine unlearning methods demonstrate strong logit-level forgetting -- such as near-zero accuracy on the forget set -- yet continue to preserve substantial information within their internal feature representations. We refer to this discrepancy as superficial forgetting. Recent studies indicate that most existing unlearning approaches primarily alter the final classifier, leaving intermediate representations largely unchanged and highly similar to those of the original model. To address this limitation, we introduce the Erase at the Core (EC), a framework designed to enforce forgetting throughout the entire network hierarchy. EC integrates multi-layer contrastive unlearning on the forget set with retain set preservation through deeply supervised learning. Concretely, EC attaches auxiliary modules to intermediate layers and applies both contrastive unlearning and cross-entropy losses at each supervision point, with layer-wise weighted losses. Experimental results show that EC not only achieves effective logit-level forgetting, but also substantially reduces representational similarity to the original model across intermediate layers. Furthermore, EC is model-agnostic and can be incorporated as a plug-in module into existing unlearning methods, improving representation-level forgetting while maintaining performance on the retain set.

机器遗忘特征清除隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。