噪声与双边滤波结合,显著提升CNN抗攻击能力且计算开销极低。
A combination of noise and bilateral filters achieve supralinear and scalable adversarial robustness in CNNs

- 将高斯噪声与双边滤波结合作为预处理,协同增强鲁棒性。
- 在RobustBench上实现次优防御性能,训练耗时仅15%~35%。
- 适合追求高效、可扩展鲁棒性的实际部署场景。
深度神经网络对对抗样本的脆弱性严重制约其真实应用。现有增强鲁棒性的方法依赖对抗训练,虽有效但计算成本高且针对特定攻击。已有研究尝试添加高斯噪声或图像滤波,虽能适度提升鲁棒性,但效果有限。本文理论证明,噪声与滤波通过互补机制增强鲁棒性,联合使用可实现超线性提升。实验表明,简单预处理器(高斯噪声+双边滤波)在极低计算开销下实现超线性鲁棒性提升。将其与对抗训练结合,在RobustBench测试中,自动攻击(AutoAttack)排名第二,整体第三;相比顶尖防御模型,仅需约35%训练浮点运算量(FLOPs)、50%参数量、33%训练轮数和15%数据量。此外,该方法具备良好可扩展性,在三个数量级范围内,以2-8倍更少的总计算量达到同等精度。整体方案设计简洁、理论扎实,计算开销可忽略,易于集成。
原文摘要 · Abstract (English)
The vulnerability of deep neural networks to adversarial examples poses a significant challenge for real-world deployment. Existing techniques to enhance deep network robustness rely on adversarial training, an approach that is powerful but computationally intensive and typically tailored to specific attack types. To address these limitations, existing works have explored techniques such as adding gaussian noise or filtering images, both of which can boost the network robustness to various adversarial attacks, albeit modestly. Here, we theoretically demonstrate that these two approaches enhance robustness against adversarial attacks through complementary mechanisms, resulting in supralinear robustness when combined. Building on this insight, we experimentally show that a simple preprocessor combining Gaussian noise and bilateral filtering yields supralinear improvements in adversarial robustness with minimal computational cost. Next, we combine our preprocessor with adversarial training and test on RobustBench to assess its supralinear improvement over state-of-the-art defenses. First, this combination ranks second on AutoAttack and third overall, while using only $\sim$35% of the training FLOPs, using a model with $\sim$50% less parametets, trained with $\sim$33% of the epochs and $\sim$15% the data compared to state-of-the-art defenses. Second, our method scales efficiently, matching the accuracy of competing models with roughly 2-8x less total compute across 3 orders of magnitude. Overall, our approach provides a principled and easily integrable framework for enhancing adversarial robustness, offering negligible computational overhead and a simple yet theoretically grounded design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。