通过能量调控实现跨域遗忘,让模型删掉特定数据时更精准、影响更小。
Cross-Domain Generalization in Machine Unlearning via Label-Conditioned Energy Magnitude Regularization

- 用标签条件能量模型显式控制每类数据的能量,使遗忘过程可观察。
- 在DomainNet上遗忘老虎等类,跨域遗忘准确率达98%~99%,且影响相近类别。
- 在CIFAR-10上完全遗忘单类,其余类别准确率仍保持98.5%以上。
机器遗忘旨在消除训练模型中特定数据的影响。现有方法多将被遗忘概念视为孤立存在,忽略了其对整体模型的影响。本文采用标签条件能量模型(EBM),为每类分配独立能量,使遗忘效果可直接观测。通过提升目标类图像-标签对的能量,并引入遗忘项、保留锚点、全局边界和能量正则化,防止能量无限增长。同时设计传播项,将遗忘信号按DINOv2相似度加权传递给与遗忘类相似的样本,实现对近似样本的定向遗忘,而其他样本不受影响。在两个基准数据集上评估:1)在DomainNet的四个视觉域子集上,分别遗忘老虎、狮子和剪刀。在草图域遗忘后,真实、剪贴画和绘画域中的对应类也显著消失,遗忘错误达98%~99%,且影响扩展至最相似类别;2)在CIFAR-10上关闭传播项,单独遗忘每个类。遗忘效果完全(100%),其余九类平均准确率仍保持98.5%。
原文摘要 · Abstract (English)
Machine unlearning removes the influence of specific data from a trained model. However, most methods treat the forgotten concept as isolated. In this paper, we study what happens to the rest of the model when a class is forgotten, using a label-conditioned energy-based model (EBM) that assigns per-class energies, making the effect directly observable. We forget a class by raising the energy of its image-label pairs, training with a forget term, a retain anchor to the pretrained model, a global margin, and an energy regularizer that stops the energy magnitudes from growing without limit. A propagation term applies the same forget signal to retain samples, weighted by each sample's DINOv2 similarity to the forget class, so forgetting reaches images that resemble it and leaves the rest untouched. We evaluate on two benchmark datasets: 1) On a subset of DomainNet across four visual domains, we forget tiger, lion, and scissors one at a time. Forgetting a class in the sketch domain also erases it from real, clipart, and painting, with forgetting error reaching 98% and 99% for lion and scissors, and the effect carrying over to the most similar class. 2) On CIFAR-10, we turn off the propagation term and forget each of the ten classes on its own. Forgetting is complete (100%), while the other nine classes retain 98.5% of their pre-unlearning accuracy on average.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。