arXiv:2509.20851cs.CV2025-09被引 2

攻击视频大模型的采样机制,让有害内容逃过检测

Poisoning Prompt-Guided Sampling in Video Large Language Models

  • 用一个视频级扰动干扰提示引导采样排名,使有害片段不被选中
  • 在18组测试中平均攻击成功率84%~97%,且能绕过七种防御
  • 揭示采样机制存在结构性安全漏洞,适合安全研究者关注

视频大语言模型(VideoLLMs)日益用于用户生成视频平台的自动审核,但只需几秒有害内容即可触发安全警报。由于全帧编码成本过高,现代视频模型依赖提示引导采样(PGS),根据用户提示对帧评分并仅传递最高分帧给视觉编码器。均匀采样和语义采样易被简单帧替换攻破,而更敏感的PGS虽曾被认为更安全,实则仍存漏洞。本文提出PoisonVID攻击:无需目标模型权重、梯度或采样内部信息,仅通过优化一个视频级扰动,在由影子VideoLLM与通用语言模型生成的多种有害描述集合上施加相关性抑制损失,使有害帧被驱离提示条件子空间,从而永不被采样。其他不依赖该评分的采样器仍保留原帧,表明失败发生在选择阶段而非编码阶段。在三种PGS方法、六种VideoLLMs及六类有害内容下,攻击平均成功率达84%至97%,且通过七种防御。在摄入时降低分辨率重编码可部分恢复被剔除内容,但使攻击成功率下降48个百分点,说明威胁未被消除。因此,PGS以牺牲结构性安全为代价换取准确率,采样设计必须重新考虑此安全债务。

原文摘要 · Abstract (English)

Video Large Language Models (VideoLLMs) are increasingly deployed as automated moderators on user-generated video platforms, where a few unwatched seconds of harmful footage are enough to suppress a safety alert. Because encoding every frame is prohibitive, modern VideoLLMs rely on prompt-guided sampling (PGS), which scores frames against the user prompt and forwards only the top-ranked ones to the visual encoder. Uniform and semantic samplers are known to be defeated by simple frame replacement, whereas PGS, the most prompt-aware family, has escaped scrutiny, and its prompt awareness in fact repairs the omission failures that defeat the other two. We show that this repair is superficial, since PoisonVID, a transfer attack, poisons the sampler's ranking so that harmful clips are never surfaced, without access to target weights, gradients, or sampling internals. It optimizes one video-level perturbation under a relevance-suppression loss defined over a depiction set of paraphrased harmful descriptions written by a shadow VideoLLM and a general-purpose language model, which drives perturbed harmful frames out of the prompt-conditioned subspace that PGS reads. Samplers that never consult that score keep the frames they always kept, which locates the failure at selection rather than at the encoder. Across three PGS methods, six VideoLLMs, and six harmful categories, PoisonVID attains 84% to 97% average attack success over the 18 sampler and model pairs and survives seven defenses. Re-encoding at lower resolution on ingest gives back part of what was evicted and costs the attack 48 points, which bounds the threat without closing it. PGS therefore buys accuracy with a structural safety debt, and sampler design will now have to repay that.

视频安全对抗攻击采样机制大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。