arXiv:2412.07253cs.CV2024-12被引 1

让对抗补丁自动匹配背景,隐蔽性更强还有效

CapGen:An Environment-Adaptive Generator of Adversarial Patches

  • 根据环境色调整补丁颜色,实现视觉隐身
  • 发现图案比颜色对攻击效果影响更大
  • 适合研究对抗样本或物理安全的学者

对抗补丁常用于保护关键资产或测试感知算法鲁棒性,但通常忽略与背景的视觉协调性,易被察觉。现有方法多关注提升攻击性能,忽视补丁元素的复杂动态。本文提出伪装对抗补丁生成器(CAPGen),利用环境基础色生成能无缝融入背景的补丁,在保持强攻击性的同时实现更优视觉隐蔽性。我们深入分析了图案(即无色纹理信息)与颜色对补丁攻击效果的影响,发现图案作用显著大于颜色。基于此,提出快速生成策略:将高性能补丁的颜色更新为新环境匹配色,实现视觉隐蔽且不损失攻击能力。本文首次系统探讨图案与颜色在对抗补丁中的作用。

原文摘要 · Abstract (English)

Adversarial patches, often used to provide physical stealth protection for critical assets and assess perception algorithm robustness, usually neglect the need for visual harmony with the background environment, making them easily noticeable. Moreover, existing methods primarily concentrate on improving attack performance, disregarding the intricate dynamics of adversarial patch elements. In this work, we introduce the Camouflaged Adversarial Pattern Generator (CAPGen), a novel approach that leverages specific base colors from the surrounding environment to produce patches that seamlessly blend with their background for superior visual stealthiness while maintaining robust adversarial performance. We delve into the influence of both patterns (i.e., color-agnostic texture information) and colors on the effectiveness of attacks facilitated by patches, discovering that patterns exert a more pronounced effect on performance than colors. Based on these findings, we propose a rapid generation strategy for adversarial patches. This involves updating the colors of high-performance adversarial patches to align with those of the new environment, ensuring visual stealthiness without compromising adversarial impact. This paper is the first to comprehensively examine the roles played by patterns and colors in the context of adversarial patches.

对抗样本视觉隐身图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。