通过调整模型前端响应提升对抗样本迁移性。
Enhancing Adversarial Transferability through Block Stretch and Shrink
- 从隐式集成视角设计输入变换,增强模型前端响应多样性。
- 在ImageNet子集上,跨多种CNN和ViT模型显著提升迁移成功率。
- 适合研究对抗攻击迁移性与输入预处理的学者参考。
基于输入变换的对抗攻击通过在变换后的输入上聚合梯度来提升迁移性。现有分析多从图像多样性、语义保持、注意力方差或假设空间扩展等角度解释其有效性,却忽略了模型前端响应的关键作用。本文从隐式集成视角重新审视变换攻击:每种变换可视为在代理模型前的预处理操作,引发不同的前端响应以实现梯度聚合。基于此,我们提出FRO(Frontend Response-Oriented)方法,通过两种互补算子丰富前端响应:局部缩放算子通过块级拉伸与收缩扰动局部内容采样,投影算子则通过一致的透视变形修改全局空间结构。二者协同生成有结构的变换视图,优化可迁移对抗扰动。在ImageNet子集上的实验表明,FRO在多种CNN与视觉变压器模型间持续提升黑盒迁移性。我们进一步分析隐式集成规模的影响,并在统一集成尺度下评估不同变换方法,验证了从前端响应集成角度设计输入变换的优越性。
原文摘要 · Abstract (English)
Input transformation-based attacks improve adversarial transferability by aggregating gradients over transformed inputs. Existing analyses mainly explain their efficacy from image diversity, semantic preservation, attention variance or hypothesis space augmentation, yet overlook the critical role of model frontend responses. In this paper, we revisit transformation-based attacks from an implicit ensemble perspective: each transformation can be viewed as a pre-processing operator before the surrogate model, inducing a distinct frontend response for gradient aggregation. Based on this view, we propose FRO, a Frontend Response-Oriented input transformation method that enriches such responses through two complementary operators. The Local Scaling Operator perturbs local content sampling via block-wise stretch-and-shrink operations, while the Projection Operator modifies global spatial organization through coherent perspective deformation. Together, they produce structured transformed views to optimize transferable adversarial perturbations. Experiments on an ImageNet subset show that FRO consistently improves black-box transferability across diverse CNN and Vision Transformer models. We further analyze the effect of implicit ensemble size and evaluate different transformation-based methods under a unified ensemble scale, demonstrating the superiority of designing input transformations from the perspective of front-end response ensembles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。