通过特征空间重构实现高效机器遗忘,无需依赖标签或梯度。
Approximate Machine Unlearning through Manifold Representation Forgetting Guided by Self Mode Connectivity

- 在特征空间中将删除样本推向保留数据的语义邻居。
- 在四个数据集上效果接近顶尖方法,且不依赖任务梯度。
- 自适应生成边界,提升遗忘一致性,适合隐私保护场景。
机器遗忘是实现被遗忘权的基础机制。现有基于标签操作或任务梯度反转的方法通常效果有限,且可能破坏原始学习目标,难以保证与重训练等效。本文提出ManiF-SMC(基于自模式连通性的特征流形遗忘),观察到重训练后模型会根据保留数据的语义相似性对被删除样本进行分类。我们将近似遗忘重新定义为:将每个被删除样本从其原特征流形中心推向保留数据中最邻近的语义邻居。该方法在表示空间中运行,减少对标签和任务特定梯度的依赖。为此,我们设计了基于三元组损失的联合目标函数,并引入自模式连通模块,快速重构局部流形以自适应生成每例遗忘所需的边界。在四个代表性数据集上的大量实验表明,ManiF-SMC在性能上可媲美当前最优近似方法,且完全在模型表示空间内完成。
原文摘要 · Abstract (English)
Machine unlearning is a fundamental mechanism that enforces the right to be forgotten. Existing unlearning studies that rely on label manipulation or task-gradient reversal often deliver limited unlearning effectiveness. Moreover, they can undermine the original learning objective and typically do not guarantee equivalence to standard unlearning by retraining. In this paper, we propose \textbf{ManiF-SMC} (\textbf{Mani}fold \textbf{F}orgetting with \textbf{S}elf \textbf{M}ode \textbf{C}onnectivity), motivated by the observation that a model retrained on the remaining data tends to classify erased samples by their semantic similarity to the retained data. We begin with systematically recasting the approximate unlearning as pushing each erased sample away from its original learned manifold representation centroid toward its nearest semantic neighbors in the retained data. This reformulation aligns unlearning with retraining behavior and operates purely in representation space, reducing reliance on labels and task-specific gradients. To tackle the manifold representation-based unlearning problem, ManiF-SMC encapsulates the unlearning and representation preservation goals in a margin-based triplet loss. Because finding a suitable margin for unlearning is challenging, we propose a self-mode-connectivity module that rapidly reconstructs the local manifold to guide the adaptive margins generation for each unlearning case. Extensive experiments on four representative datasets show that ManiF-SMC achieves unlearning effectiveness comparable to state-of-the-art approximate methods while operating solely within the model's representation space.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。