arXiv:2605.24420cs.LGcs.AI2026-05

批归一化会放大模型对异常数据的记忆,增加隐私泄露风险。

Batch Normalization Amplifies Memorization and Privacy Risks

论文配图:Batch Normalization Amplifies Memorization and Privacy Risks
图 1 · 摘自论文原文
  • 通过梯度范数分析发现,批归一化增强异常样本的训练影响。
  • 含批归一化的模型在成员推断攻击中泄露隐私的概率显著升高。
  • 适合关注模型隐私安全的研究者和工业应用开发者参考。

批归一化(BN)广泛用于加速深度神经网络的收敛并提升训练稳定性,但其对隐私和记忆化的影响尚未深入研究。本文通过三种互补方法展开实证研究:(i) 对分布外训练样本的无意记忆;(ii) 基于梯度范数的单样本影响度量;(iii) 对成员推断攻击(MIA)的敏感性。在多个数据集和模型架构上,我们一致发现,含BN的模型对异常样本的记忆显著高于无BN模型。关键的是,这种被放大的记忆直接导致隐私漏洞:含BN模型在MIA中表现出更高的攻击成功率。我们进一步提供理论分析,表明BN会放大训练过程中异常样本的每步影响,揭示该现象的机制。结果揭示了BN带来的未被重视的隐私风险,并为归一化层如何增强罕见或敏感样本的影响提供了实践与理论洞见。

原文摘要 · Abstract (English)

Batch Normalization (BN) is widely adopted to enable faster convergence and more stable training of deep neural networks. However, its impact on privacy and memorization has remained largely unexplored. In this work, we investigate the effect of BN layers on the memorization of atypical or outlier samples and its implications for privacy leakage. We conduct an extensive empirical study using three complementary approaches: (i) unintended memorization of out-of-distribution training samples, (ii) per-sample influence measured via gradient norms, and (iii) susceptibility to membership inference attacks (MIA). Across multiple datasets and architectures, we consistently observe that BN substantially increases the memorization of outliers compared to models without BN. Critically, this amplified memorization translates directly into privacy vulnerabilities: models with BN exhibit significantly higher susceptibility to MIAs. We complement our empirical findings with a theoretical analysis showing that BN amplifies the per-step influence of outlier samples during training, providing mechanistic insight into this phenomenon. Our results highlight an underappreciated privacy risk associated with BN and provide both practical and theoretical insights into how normalization layers can amplify the influence of rare or sensitive training examples.

隐私保护批归一化成员推断攻击模型记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。