发现批量归一化导致机器遗忘评估假象,可能误导所有现有方法结论。
The BatchNorm Illusion: Diagnosing Normalization Artifacts in Machine Unlearning Evaluation

- 用前向传播重置归一化统计量,可伪造遗忘效果
- 实验显示最高使遗忘准确率虚增78个百分点
- 适合关注模型可解释性与评估可信度的研究者
近似机器遗忘旨在不从头训练的情况下移除特定训练数据对模型的影响。我们发现,在基于批量归一化(BatchNorm)的架构中,存在一种此前未被记录的混淆因素:仅对保留数据进行一次前向传播(不修改任何权重),即可确定性地重写模型的归一化状态,从而逆转表面指标上的遗忘表现。我们将此操作形式化为保持权重的不动点算子,并证明其引发的前后差距必然源于BN运行统计量,而非遗忘方法对权重的实际修改。该归因清晰区分了测量误差(BN伪影)与编码器失效(残差权重信息,近期并发工作已报道),且同一算子框架可唯一分解线性探测提升为BN测量偏差与编码器几何成分。实证上,该伪影在标准基准上使九种方法的主遗忘准确率最高虚增78个百分点;仅10张无标签图像的攻击者即可恢复大部分被掩蔽的准确率;严格使用GroupNorm控制则将伪影降至零。重新校准后,成员推断攻击表现基本不变,说明评估失败源于遗忘准确率与线性探测指标。
原文摘要 · Abstract (English)
Approximate machine unlearning aims to remove the influence of specific training data from a trained model without retraining from scratch. We identify a previously undocumented confound in how unlearning is evaluated on BatchNorm-based architectures: a single forward pass over retain data, an operation that modifies no weight, can deterministically rewrite the model's normalization state and reverse the apparent surface-metric forgetting. We formalize this operation as a weight-preserving fixed-point operator and prove that any pre-versus-post gap it induces is provably attributable to BN running statistics rather than to any modification the unlearning method made to the weights. This attribution claim cleanly separates measurement failure (BN artifact) from encoder failure (residual weight-encoded information, recently documented in concurrent work), and the same operator framework yields a unique decomposition of linear-probe elevation into BN-measurement-bias and encoder-geometry components. Empirically, the artifact reverses headline forget accuracy by up to 78 pp across nine evaluated methods on standard benchmarks; an attacker with as few as 10 unlabeled images recovers most of the masked accuracy; and a strict GroupNorm control reduces the artifact to zero across all methods. The tested membership-inference attacks change little under recalibration, locating the observed evaluation failure in forget accuracy and linear probing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。