arXiv:2411.17283cs.CV2024-11被引 1

提出新型架构后门攻击BadScan,可隐蔽诱导视觉状态空间模型误判。

BadScan: An Architectural Backdoor Attack on Visual State Space Models

  • 利用位平面切分生成视觉不可察觉的触发图像
  • 通过异或检测触发,动态替换原模型扫描机制
  • 对VMamba及其变体有效,重训练后仍能发动攻击

新提出的视觉状态空间模型(VMamba)采用状态空间机制(SSM)将图像视为补丁序列,在多种计算机视觉任务中表现优于视觉Transformer(ViT)。然而,深度模型易受对抗攻击。现有方法常通过在训练数据中嵌入触发器来重训练模型,导致其将样本错误分类,即后门攻击。本文首先评估了VMamba对现有后门攻击的鲁棒性,进而提出一种新型架构级后门攻击——BadScan,专门针对VMamba。该攻击利用位平面切分生成视觉不可察觉的后门图像。测试时,若通过第k位平面的异或操作检测到触发器,则将原模型中的传统二维选择性扫描(SS2D)机制替换为新设计的BadScan模块,该模块包含四种新扫描模式。实验结果表明,尽管视觉状态空间模型通常对当前后门攻击具有较强鲁棒性,但BadScan攻击尤为有效,在CIFAR-10和ImageNet-1K两个常用图像分类数据集上,显著提升了触发准确率(TAR),且即使从零开始完全重训练,攻击依然有效。

原文摘要 · Abstract (English)

The newly introduced Visual State Space Model (VMamba), which employs \textit{State Space Mechanisms} (SSM) to interpret images as sequences of patches, has shown exceptional performance compared to Vision Transformers (ViT) across various computer vision tasks. However, recent studies have highlighted that deep models are susceptible to adversarial attacks. One common approach is to embed a trigger in the training data to retrain the model, causing it to misclassify data samples into a target class, a phenomenon known as a backdoor attack. In this paper, we first evaluate the robustness of the VMamba model against existing backdoor attacks. Based on this evaluation, we introduce a novel architectural backdoor attack, termed BadScan, designed to deceive the VMamba model. This attack utilizes bit plane slicing to create visually imperceptible backdoored images. During testing, if a trigger is detected by performing XOR operations between the $k^{th}$ bit planes of the modified triggered patches, the traditional 2D selective scan (SS2D) mechanism in the visual state space (VSS) block of VMamba is replaced with our newly designed BadScan block, which incorporates four newly developed scanning patterns. We demonstrate that the BadScan backdoor attack represents a significant threat to visual state space models and remains effective even after complete retraining from scratch. Experimental results on two widely used image classification datasets, CIFAR-10, and ImageNet-1K, reveal that while visual state space models generally exhibit robustness against current backdoor attacks, the BadScan attack is particularly effective, achieving a higher Triggered Accuracy Ratio (TAR) in misleading the VMamba model and its variants.

后门攻击视觉模型状态空间安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。