arXiv:2511.18656cs.CV2025-11

让对抗补丁在缩放时仍有效,提升真实场景攻击成功率。

Robust Physical Adversarial Patches Using Dynamically Optimized Clusters

  • 用SLIC算法动态聚类像素,生成抗缩放的补丁结构。
  • 数字与物理实验均显示攻击成功率显著提升。
  • 适合研究对抗攻击鲁棒性或安全评估的开发者。

针对深度学习系统的真实世界对抗攻击,通常通过在场景中放置对抗补丁来操纵模型输出。传统补丁训练需正则化以提升物理可实现性(如可打印性、平滑度)和对真实世界变化的鲁棒性(如形变、视角、噪声)。但缩放变化常被忽视:补丁缩放时,插值导致颜色混合,破坏高频图案,削弱对抗信号。为此,本文提出基于超像素的新型正则化方法,引导补丁优化为尺度鲁棒结构。采用SLIC算法在优化过程中动态聚类补丁像素,利用隐函数定理反向传播梯度至超像素边界与颜色,实现结构自适应调整。该方法在数字域表现更优,且物理实现后性能保持,提升真实攻击效果。通过屏幕与纸板剪裁组合的新评估协议,系统化测试了多种真实条件下的性能。

原文摘要 · Abstract (English)

Physical adversarial attacks on deep learning systems is concerning due to the ease of deploying such attacks, usually by placing an adversarial patch in a scene to manipulate the outcomes of a deep learning model. Training such patches typically requires regularization that improves physical realizability (e.g., printability, smoothness) and/or robustness to real-world variability (e.g. deformations, viewing angle, noise). One type of variability that has received little attention is scale variability. When a patch is rescaled, either digitally through downsampling/upsampling or physically through changing imaging distances, interpolation-induced color mixing occurs. This smooths out pixel values, resulting in a loss of high-frequency patterns and degrading the adversarial signal. To address this, we present a novel superpixel-based regularization method that guides patch optimization to scale-resilient structures. Our ap proach employs the Simple Linear Iterative Clustering (SLIC) algorithm to dynamically cluster pixels in an adversarial patch during optimization. The Implicit Function Theorem is used to backpropagate gradients through SLIC to update the superpixel boundaries and color. This produces patches that maintain their structure over scale and are less susceptible to interpolation losses. Our method achieves greater performance in the digital domain, and when realized physically, these performance gains are preserved, leading to improved physical performance. Real-world performance was objectively assessed using a novel physical evaluation protocol that utilizes screens and cardboard cut-outs to systematically vary real-world conditions.

对抗攻击图像处理鲁棒性深度学习安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。