用预测编码网络预处理图像,显著提升模型抗攻击能力。
Protecting Feed-Forward Networks from Adversarial Attacks Using Predictive Coding
- 用预测编码网络作为前置模块,无须修改主模型
- 在MNIST和CIFAR10上分别提升82%和65%的鲁棒性
- 仅需少量数据训练,适合实际部署的防御场景
对抗样本是为误导机器学习模型而设计的微小扰动输入,通常对人眼不可见,暴露了模型泛化能力的弱点。现有防御方法多需模型参与、结构改动或大量对抗样本训练,难以实用。本研究提出一种轻量级方案:在前馈网络前加入预测编码网络(PCnet)作为预处理模块。实验表明,在MNIST和CIFAR10数据集上,该方法分别实现约82%和65%的鲁棒性提升。PCnet仅需少量数据训练,凭借其生成特性将被扰动图像还原为原始形态,有效抑制对抗攻击。该方法无需修改主模型,具有良好的可部署性。
原文摘要 · Abstract (English)
An adversarial example is a modified input image designed to cause a Machine Learning (ML) model to make a mistake; these perturbations are often invisible or subtle to human observers and highlight vulnerabilities in a model's ability to generalize from its training data. Several adversarial attacks can create such examples, each with a different perspective, effectiveness, and perceptibility of changes. Conversely, defending against such adversarial attacks improves the robustness of ML models in image processing and other domains of deep learning. Most defence mechanisms require either a level of model awareness, changes to the model, or access to a comprehensive set of adversarial examples during training, which is impractical. Another option is to use an auxiliary model in a preprocessing manner without changing the primary model. This study presents a practical and effective solution -- using predictive coding networks (PCnets) as an auxiliary step for adversarial defence. By seamlessly integrating PCnets into feed-forward networks as a preprocessing step, we substantially bolster resilience to adversarial perturbations. Our experiments on MNIST and CIFAR10 demonstrate the remarkable effectiveness of PCnets in mitigating adversarial examples with about 82% and 65% improvements in robustness, respectively. The PCnet, trained on a small subset of the dataset, leverages its generative nature to effectively counter adversarial efforts, reverting perturbed images closer to their original forms. This innovative approach holds promise for enhancing the security and reliability of neural network classifiers in the face of the escalating threat of adversarial attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。