arXiv:2411.15439cs.CV2024-11被引 2

用频域生成隐形与可见触发器,实现隐蔽且高效的检测模型后门攻击

Twin Trigger Generative Networks for Backdoor Attacks against Object Detection

  • 在频域设计双触发生成网络,训练时用隐形触发,推理时用可见触发
  • 使模型mAP_0.5下降70.0%至84.5%,对YOLOv5/v7均有效
  • 触发器可动态变化,难被检测,适合研究模型安全漏洞的学者

目标检测模型广泛应用于实际场景,但易受后门攻击。由于用户常依赖第三方数据集或预训练模型,现有研究多集中于图像分类的后门攻击,对目标检测的研究较少。且多数攻击使用人工生成的固定模式触发器,需前后一致,易被发现或难以适配不同场景。为此,本文提出新型频域双触发生成网络:训练阶段生成不可见触发器以隐蔽植入后门,推理阶段生成可见触发器以稳定激活恶意行为。针对不可见触发器,引入高斯平滑层和高频伪影分类器提升隐蔽性;针对可见触发器,设计新颖对齐损失,使其与原模式不同但仍能触发相同恶意行为。大量实验表明,该方法可在训练与推理阶段使用不同触发器,显著降低目标检测器的mAP_0.5达70.0%~84.5%,涵盖YOLOv5与YOLOv7多种配置。

原文摘要 · Abstract (English)

Object detectors, which are widely used in real-world applications, are vulnerable to backdoor attacks. This vulnerability arises because many users rely on datasets or pre-trained models provided by third parties due to constraints on data and resources. However, most research on backdoor attacks has focused on image classification, with limited investigation into object detection. Furthermore, the triggers for most existing backdoor attacks on object detection are manually generated, requiring prior knowledge and consistent patterns between the training and inference stages. This approach makes the attacks either easy to detect or difficult to adapt to various scenarios. To address these limitations, we propose novel twin trigger generative networks in the frequency domain to generate invisible triggers for implanting stealthy backdoors into models during training, and visible triggers for steady activation during inference, making the attack process difficult to trace. Specifically, for the invisible trigger generative network, we deploy a Gaussian smoothing layer and a high-frequency artifact classifier to enhance the stealthiness of backdoor implantation in object detectors. For the visible trigger generative network, we design a novel alignment loss to optimize the visible triggers so that they differ from the original patterns but still align with the malicious activation behavior of the invisible triggers. Extensive experimental results and analyses prove the possibility of using different triggers in the training stage and the inference stage, and demonstrate the attack effectiveness of our proposed visible trigger and invisible trigger generative networks, significantly reducing the mAP_0.5 of the object detectors by 70.0% and 84.5%, including YOLOv5 and YOLOv7 with different settings, respectively.

后门攻击目标检测生成模型模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。