利用神经网络隐式偏置,无需参考模型即可精准识别训练数据。
ImpMIA: Leveraging Implicit Bias for Membership Inference Attack
- 基于最大间隔隐式偏置理论,通过KKT条件定位梯度重建最强的训练样本。
- 在仅知模型权重和训练数据超集条件下,性能超越现有黑盒与白盒攻击。
- 无需假设训练参数或分布一致性,适用于公开模型场景。
确定模型训练所用数据样本(即成员推断攻击)是影响数据隐私的重要问题。当前最先进方法(黑盒攻击)依赖大量辅助参考模型来模仿目标模型行为,但其假设在真实场景中很少成立:(i) 攻击者需知晓训练超参数;(ii) 所有非训练样本来自与训练数据相同分布;(iii) 评估集中训练数据占比已知。我们发现移除这些假设会显著降低黑盒攻击性能。本文提出ImpMIA,一种利用神经网络隐式偏置的成员推断攻击。基于最大间隔隐式偏置理论,ImpMIA利用Karush-Kuhn-Tucker(KKT)最优性条件识别训练样本——即那些梯度最能重构模型参数的样本。该方法为优化驱动,无需训练参考模型,从而摆脱对目标模型训练过程的任何知识或假设。尽管ImpMIA属于白盒攻击(需访问模型权重),但随着许多模型通过Hugging Face等平台公开,这一前提日益现实。在仅知模型权重和训练数据超集的设置下,ImpMIA在性能上优于现有黑盒与白盒攻击。
原文摘要 · Abstract (English)
Determining which data samples were used to train a model, known as Membership Inference Attack (MIA), is a well-studied and important problem with implications on data privacy. SotA methods (which are black-box attacks) rely on training many auxiliary reference models to imitate the behavior of the attacked model. As such, they rely on assumptions which rarely hold in real-world settings: (i) the attacker knows the training hyperparameters; (ii) all available non-training samples come from the same distribution as the training data; and (iii) the fraction of training data in the evaluation set is known. We show that removing these assumptions significantly harms the performance of black-box attacks. We introduce ImpMIA, a Membership Inference Attack that exploits the Implicit Bias of neural networks. Building on the maximum-margin implicit bias theory, ImpMIA uses the Karush-Kuhn-Tucker (KKT) optimality conditions to identify training samples -- those whose gradients most strongly reconstruct the trained model's parameters. Our approach is optimization-based, and requires NO training of reference-models, thus removing the need for any knowledge/assumptions regarding the attacked model's training procedure. While ImpMIA is a white-box attack (a setting which assumes access to model weights), this is becoming increasingly realistic given that many models are publicly available (e.g., via Hugging Face). ImpMIA achieves SotA performance compared to both black and white box attacks in settings where only the model weights are known, and a superset of the training data is available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。