提出新方法在不重训练情况下高效删除类别,避免误删保留类特征。
SCOPE: Entanglement Frontier Escape for Source-Free Class Unlearning

- 基于输入条件动态投影,仅抑制需删除类的特征空间。
- 在五组不同数据集上均超越现有方法,最难点下性能领先所有模型。
- 无需保留数据或反向传播,计算成本远低于重新训练。
无源类别遗忘旨在仅使用遗忘数据擦除完整类别,评估在表征层面进行,此时特征可能泄露已被分类头忽略的类别。现有特征空间擦除方法采用单一固定投影,但遗忘与保留类别共享表征,导致删除一个类别时干扰重叠部分。我们证明此矛盾为前沿边界:任何固定投影在删除时至少付出沿遗忘判别子空间的保留读出能量代价,仅删除该子空间即可达到理论下限。当前主流无源擦除方法均符合此形式,因此整体受限于该前沿。通过条件化擦除过程可突破此边界。谱条件投影擦除(SCOPE)利用单个门控机制,仅在输入被冻结分类头判定为遗忘类别时抑制遗忘子空间。该方法为闭式解,无需保留数据或梯度训练,计算成本远低于重训练。在涵盖两个模态、多种骨干网络的五个物体、人脸与说话人基准测试中,前沿预测了实际保留代价;SCOPE 在所有基准与遗忘集大小上均优于现有无源擦除方法,在最困难设置下超越所有已知未学习模型,包括训练模型。
原文摘要 · Abstract (English)
Source-free class unlearning erases whole classes using only the forget data, judged at the representation level, where features can leak a class the head no longer predicts. Existing feature-space erasers answer with one fixed projection, yet forget and retain classes share a representation, so deleting one disturbs the other where they overlap. We prove this tension is a frontier. Every fixed projection that deletes pays a retain cost of at least the retain-readout energy along the forget-discriminant subspace, and erasing that subspace alone attains the floor. The leading source-free erasers all instantiate the form it binds, so the frontier limits the whole class. Conditioning the erasure on the input escapes it. Spectral Conditional Projective Erasure (SCOPE) does so with a single gate, suppressing the forget subspace chiefly on inputs its frozen head's weight scores read as a forget class. It is closed form, needs no retain data or gradient training, and costs orders of magnitude less than retraining. Across five object, face, and speaker benchmarks spanning two modalities and both convolutional and transformer backbones, the frontier predicts the measured retain cost. SCOPE leads the source-free erasers on every benchmark and forget-set size, and at the hardest setting it tops every unlearner, trained methods included.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。