用扩散模型重生成图像,智能消除目标检测中的对抗补丁攻击
DisPatch: Disarming Adversarial Patches in Object Detection with Diffusion Models
- 通过扩散模型重生成整张图像,恢复原始无害状态
- 在隐藏攻击上达89.3% [email protected],创建攻击成功率降至24.8%
- 无需预先知道攻击补丁,适用于多种真实场景防御
目标检测广泛应用于安防监控与视频分析等实际场景。尽管性能不断提升,当前先进检测器仍易受对抗补丁攻击影响,攻击者可将补丁贴于真实物体上隐藏目标或伪造不存在的物体,造成严重后果。本文提出DisPatch,首个基于扩散模型的目标检测防御框架。不同于传统‘检测并移除’策略,DisPatch采用‘重生成并修正’方法,利用扩散模型对输入图像进行整体再生,使其符合正常数据分布;再通过修正过程识别并替换对抗区域为再生后的正常内容。该方法不依赖攻击先验信息,具备攻击无关性。大量实验表明,DisPatch在多种检测器上均优于现有防御方案,在隐藏攻击中实现89.3%的[email protected],未定向创建攻击成功率降至24.8%。同时兼顾有效性与效率,对自适应攻击保持强鲁棒性,具备实用价值。
原文摘要 · Abstract (English)
Object detection is fundamental to various real-world applications, such as security monitoring and surveillance video analysis. Despite their advancements, state-of-the-art object detectors are still vulnerable to adversarial patch attacks, which can be easily applied to real-world objects to either conceal actual items or create non-existent ones, leading to severe consequences. In this work, we introduce DisPatch, the first diffusion-based defense framework for object detection. Unlike previous works that aim to "detect and remove" adversarial patches, DisPatch adopts a "regenerate and rectify" strategy, leveraging generative models to disarm attack effects while preserving the integrity of the input image. Specifically, we utilize the in-distribution generative power of diffusion models to regenerate the entire image, aligning it with benign data. A rectification process is then employed to identify and replace adversarial regions with their regenerated benign counterparts. DisPatch is attack-agnostic and requires no prior knowledge of the existing patches. Extensive experiments across multiple detectors demonstrate that DisPatch consistently outperforms state-of-the-art defenses on both hiding attacks and creating attacks, achieving the best overall [email protected] score of 89.3% on hiding attacks, and lowering the attack success rate to 24.8% on untargeted creating attacks. Moreover, it strikes the balance between effectiveness and efficiency, and maintains strong robustness against adaptive attacks, making it a practical and reliable defense method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。