用超分辨率GAN净化分散与局部对抗补丁,速度快且鲁棒性更强。
SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Models
- 基于GAN的逐像素掩码机制,逐步清除对抗补丁。
- 对分布式补丁实现58%鲁棒性,比现有方法提升58个百分点。
- 防御延迟降低98%以上,适合实时系统部署。
随着视觉机器学习模型越来越多地应用于自动驾驶与网络物理系统,物理对抗补丁攻击的担忧日益加剧。现有防御方法虽能在高度集中局部补丁攻击下实现认证鲁棒性且对正常性能影响小,但在两方面存在不足:(i) 面对低噪声分散补丁(如DorPatch攻击)时易失效,因扰动被巧妙分散以逃避检测或遮蔽;(ii) 实现高鲁棒性所需时间与资源极多,不适用于许多对延迟敏感的网络物理系统。为此,本文提出新型防御策略SuperPure。核心创新在于设计一种对分散与局部补丁均鲁棒的像素级掩码方案,通过基于GAN的超分辨率机制逐步净化图像。在ImageNet及两个标准分类器ResNet、EfficientNet上的大量评估表明,SuperPure在三大方向超越现有水平:(i) 对常规局部补丁平均提升超过20%的鲁棒性,同时将顶1清洁准确率提升近10%;(ii) 对分布式补丁攻击实现58%的鲁棒性(而现有方法如PatchCleanser为0%);(iii) 相比PatchCleanser,防御端到端延迟降低超过98%。进一步分析显示,SuperPure对白盒攻击和不同补丁尺寸均具鲁棒性。代码已开源。
原文摘要 · Abstract (English)
As vision-based machine learning models are increasingly integrated into autonomous and cyber-physical systems, concerns about (physical) adversarial patch attacks are growing. While state-of-the-art defenses can achieve certified robustness with minimal impact on utility against highly-concentrated localized patch attacks, they fall short in two important areas: (i) State-of-the-art methods are vulnerable to low-noise distributed patches where perturbations are subtly dispersed to evade detection or masking, as shown recently by the DorPatch attack; (ii) Achieving high robustness with state-of-the-art methods is extremely time and resource-consuming, rendering them impractical for latency-sensitive applications in many cyber-physical systems. To address both robustness and latency issues, this paper proposes a new defense strategy for adversarial patch attacks called SuperPure. The key novelty is developing a pixel-wise masking scheme that is robust against both distributed and localized patches. The masking involves leveraging a GAN-based super-resolution scheme to gradually purify the image from adversarial patches. Our extensive evaluations using ImageNet and two standard classifiers, ResNet and EfficientNet, show that SuperPure advances the state-of-the-art in three major directions: (i) it improves the robustness against conventional localized patches by more than 20%, on average, while also improving top-1 clean accuracy by almost 10%; (ii) It achieves 58% robustness against distributed patch attacks (as opposed to 0% in state-of-the-art method, PatchCleanser); (iii) It decreases the defense end-to-end latency by over 98% compared to PatchCleanser. Our further analysis shows that SuperPure is robust against white-box attacks and different patch sizes. Our code is open-source.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。