发现模型遗忘主要由梯度集中决定,而非权重重要性选择。
Gradient Concentration, Not Weight Saliency, Explains Representation-Level Class Unlearning

- 通过控制实验对比梯度重要性与随机掩码,发现两者效果相当。
- 92%的梯度能量集中在最后一层,导致不同掩码策略在相同表示空间操作。
- 权重重要性选择缺乏类别特异性,适合关注表示层面遗忘机制的研究者。
机器遗忘旨在移除特定训练数据的影响,同时保持模型效用。当前多数先进方法通过基于梯度重要性的参数子集选择来实现遗忘更新。然而,这种策略对表示层遗忘的实际贡献尚不明确。本文首次在CIFAR-10和CIFAR-100上使用ResNet-18,采用匹配计算量的实验设计,对比了梯度重要性掩码、同稀疏度随机掩码与无约束更新三种配置,固定遗忘目标、优化调度和计算预算。在线性探测、原型恢复和层间CKA等表示层评估中,三者表现统计上无显著差异。研究发现,未加掩码前,约92%的平方梯度能量集中于网络末层;且重要性掩码的类别特异性低(特异性指数0.09–0.11),跨类选择高度重叠的参数子集。结果表明,在该设定下,表示层遗忘主要受梯度集中与表示几何结构驱动,而非具体权重选择。更广泛地,这些发现支持渐增证据:有效的表示层遗忘需直接作用于潜在表示,而非依赖复杂的权重选择策略。
原文摘要 · Abstract (English)
Machine unlearning aims to remove the influence of specific training data while preserving model utility. Many state-of-the-art approaches pursue this goal by restricting the forgetting update to a subset of parameters selected through gradient-based saliency. Although such methods are widely adopted, the actual contribution of saliency-based weight selection to representation-level forgetting remains unclear. In this work, we perform the first controlled ablation of the saliency masking mechanism used by SalUn. Using a matched-compute experimental design on CIFAR-10 and CIFAR-100 with ResNet-18, we compare saliency-based masking against random masks of equal sparsity and unconstrained updates, while keeping the unlearning objective, optimization schedule, and computational budget fixed. Across multiple representation-level evaluations, including linear probing, prototype recovery, and layer-wise CKA, the three configurations exhibit statistically equivalent representation-level recoverability. We find that forget gradients are strongly concentrated in the final network layers (approximately 92% of the squared gradient energy on CIFAR-10) before any mask is applied, causing all masking strategies to operate within the same representational subspace. Furthermore, saliency masks show limited class specificity (specificity index 0.09-0.11), selecting highly overlapping parameter subsets across different forget classes. Our findings suggest that, in the studied setting, representation-level forgetting is primarily governed by gradient concentration and representation geometry rather than by the specific identity of saliency-selected weights. More broadly, the results support a growing body of evidence indicating that effective representation-level unlearning requires objectives that act directly on latent representations rather than on increasingly sophisticated weight-selection strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。