arXiv:2501.08862cs.LGcs.AI2025-01被引 6

提出ARMOR框架,防止数据增强让隐私数据被模型学会。

ARMOR: Shielding Unlearnable Examples against Data Augmentation

  • 用替代模型模拟数据增强效果,动态生成抗增强的防御噪声。
  • 在4个数据集上使模型对增强后隐私数据的准确率下降60%以上。
  • 适合保护公开数据免受训练时数据增强导致的隐私泄露。

私有数据在线发布后可能被未经授权方收集用于训练深度神经网络(DNN)。为保护隐私,可在原始样本中添加防御性噪声以降低其可学习性。近期提出的不可学习样本旨在最小化训练损失,使模型几乎无法学习。然而,原始数据常在训练前经过预处理,可能恢复受保护数据中的私密信息。本文首次揭示了数据增强这一常用提升模型泛化能力的技术所引发的数据隐私泄露问题。实验表明,数据增强可使基于不可学习样本训练的模型准确率从21.3%大幅提升至66.1%。为此,我们提出防御框架ARMOR,以抵御数据增强带来的隐私威胁。针对无法访问模型训练过程的难题,设计了非局部模块辅助的替代模型,更准确捕捉数据增强的影响;并提出替代增强选择策略,通过最大化增强与未增强样本间的分布一致性,为每类选择最优增强方案;同时采用动态步长调整算法优化防御噪声生成。在4个数据集和5种数据增强方法上进行大量实验,对比6种前沿防御方法,结果表明:ARMOR能有效维持受保护私有数据的不可学习性,使模型在增强后样本上的测试准确率比基线降低最多60%。

原文摘要 · Abstract (English)

Private data, when published online, may be collected by unauthorized parties to train deep neural networks (DNNs). To protect privacy, defensive noises can be added to original samples to degrade their learnability by DNNs. Recently, unlearnable examples are proposed to minimize the training loss such that the model learns almost nothing. However, raw data are often pre-processed before being used for training, which may restore the private information of protected data. In this paper, we reveal the data privacy violation induced by data augmentation, a commonly used data pre-processing technique to improve model generalization capability, which is the first of its kind as far as we are concerned. We demonstrate that data augmentation can significantly raise the accuracy of the model trained on unlearnable examples from 21.3% to 66.1%. To address this issue, we propose a defense framework, dubbed ARMOR, to protect data privacy from potential breaches of data augmentation. To overcome the difficulty of having no access to the model training process, we design a non-local module-assisted surrogate model that better captures the effect of data augmentation. In addition, we design a surrogate augmentation selection strategy that maximizes distribution alignment between augmented and non-augmented samples, to choose the optimal augmentation strategy for each class. We also use a dynamic step size adjustment algorithm to enhance the defensive noise generation process. Extensive experiments are conducted on 4 datasets and 5 data augmentation methods to verify the performance of ARMOR. Comparisons with 6 state-of-the-art defense methods have demonstrated that ARMOR can preserve the unlearnability of protected private data under data augmentation. ARMOR reduces the test accuracy of the model trained on augmented protected samples by as much as 60% more than baselines.

隐私保护数据增强防御噪声不可学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。