宽两层网络能从对抗扰动中学习到有效特征,解释为何误标扰动也能泛化。
Wide Two-Layer Networks can Learn from Adversarial Perturbations
- 假设宽两层网络,理论证明扰动含足够类别特征
- 在任意数据分布下,误标扰动训练的模型预测与干净数据一致
- 为对抗样本可迁移和学习提供理论支撑,适合研究安全性的学者
对抗样本引发多个开放问题,例如为何能欺骗分类器以及在不同模型间转移。主流假说认为对抗扰动看似随机噪声,实则包含类别特定特征。该假说得到扰动学习成功的支持:仅用对抗样本及其错误标签训练的分类器,在正确标注的测试数据上仍具有良好泛化能力。尽管该假说与扰动学习在解释对抗样本特性方面有效,其坚实的理论基础仍有限。本研究从理论上解释了扰动学习反直觉的成功。我们假设使用宽两层网络,结果对任意数据分布成立。证明了对抗扰动包含足够类别特异性特征,使网络能够从中泛化。此外,基于错误标签对抗样本训练的分类器预测,与基于正确标签干净样本训练的分类器预测完全一致。代码已公开于 https://github.com/s-kumano/perturbation-learning。
原文摘要 · Abstract (English)
Adversarial examples have raised several open questions, such as why they can deceive classifiers and transfer between different models. A prevailing hypothesis to explain these phenomena suggests that adversarial perturbations appear as random noise but contain class-specific features. This hypothesis is supported by the success of perturbation learning, where classifiers trained solely on adversarial examples and the corresponding incorrect labels generalize well to correctly labeled test data. Although this hypothesis and perturbation learning are effective in explaining intriguing properties of adversarial examples, their solid theoretical foundation is limited. In this study, we theoretically explain the counterintuitive success of perturbation learning. We assume wide two-layer networks and the results hold for any data distribution. We prove that adversarial perturbations contain sufficient class-specific features for networks to generalize from them. Moreover, the predictions of classifiers trained on mislabeled adversarial examples coincide with those of classifiers trained on correctly labeled clean samples. The code is available at https://github.com/s-kumano/perturbation-learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。