arXiv:2512.22046cs.CVcs.CR2025-12

首次针对提示驱动视频分割模型设计有效后门攻击,突破传统方法失效瓶颈。

Backdoor Attacks on Prompt-Driven Video Segmentation Foundation Models

  • 分两阶段训练:先学触发特征,再让解码器映射到目标掩码
  • 在5个模型、2个数据集上实现超90%攻击成功率,且对正常分割影响小
  • 揭示当前视频分割模型存在被操控的严重安全漏洞,适合安全研究者关注

提示驱动的视频分割基础模型(VSFM),如SAM2,正广泛应用于自动驾驶与数字病理等领域,但其安全风险尚未充分研究。我们发现经典后门攻击(如BadNet)在此类模型上效果极差,攻击成功率(ASR)低于5%。通过梯度相似性与注意力图分析,我们发现传统训练失败的原因在于:干净样本与触发样本引发一致的图像编码器梯度,且模型注意力始终聚焦于提示指定对象而非触发器。为此,我们提出首个专用于提示驱动VSFM的后门攻击框架BadVSFM。该框架采用两阶段策略:首先学习特定触发器的编码器特征,然后训练解码器将触发帧的提示表示映射到攻击者指定的目标掩码,同时保持正常分割性能。在五个VSFM和两个数据集上的实验表明,BadVSFM在不同触发器与提示类型下均实现强而可控的后门效应,且对干净性能影响微弱。消融与可解释性分析验证了两阶段设计的必要性,五种主流防御方法仍基本无效。结果揭示了当前VSFM存在实际且未被充分重视的后门威胁。

原文摘要 · Abstract (English)

Prompt-driven Video Segmentation Foundation Models (VSFMs), such as SAM2, are increasingly used in applications including autonomous driving and digital pathology, yet their security risks remain underexplored. We study backdoor attacks against VSFMs and show that directly applying classic attacks such as BadNet is largely ineffective, yielding attack success rates (ASR) below 5%. Through gradient-similarity and attention-map analyses, we find that traditional backdoor training fails because clean and triggered samples induce aligned image-encoder gradients, while model attention remains focused on the prompt-specified object rather than the trigger. To address this limitation, we propose BadVSFM, the first backdoor attack framework tailored to prompt-driven VSFMs. BadVSFM uses a two-stage strategy that first learns trigger-specific encoder features and then trains the decoder to map triggered frame prompt representations to an attacker-specified target mask while preserving clean segmentation behavior. Experiments on five VSFMs and two datasets show that BadVSFM achieves strong, controllable backdoor effects across triggers and prompt types with limited clean-performance degradation. Ablations and interpretability analyses validate the necessity of the two-stage design, and five representative defenses remain largely ineffective. Our results reveal a practical and underexplored vulnerability of current VSFMs to backdoor threats.

后门攻击视频分割安全漏洞模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。