arXiv:2608.26971cs.CVcs.MM2026-08中稿 · ACM Multimedia 202…

通过时间维度构造攻击,让视频生成模型逐步暴露违规内容。

TempJail: Temporal Jailbreak Attacks against Image-to-Video Generation Models

论文配图:TempJail: Temporal Jailbreak Attacks against Image-to-Video Generation Models
图 1 · 摘自论文原文
  • 将恶意指令拆分为初始画面条件与时间文本指令,实现渐进式攻击。
  • 在闭源商业模型上攻击成功率比现有方法提升23.3%(GPT评估)。
  • 适合研究模型安全、对抗攻击的人员关注,揭示视频生成新风险。

近年来,图像到视频(I2V)生成模型在主体一致性和时间连贯性方面取得显著进展,实现了高质量视频合成。然而,这些进步也带来了新的安全风险。现有研究主要关注单帧违规的越狱攻击,却忽视了视频生成模型特有的时间维度。本文探究三种攻击场景,发现I2V系统存在时间性漏洞:危险语义并非来自单帧,而是随时间演进的语义组合所致。进一步识别出两个关键挑战:时间抽象与语义伪装。为此,提出TempJail框架:针对时间抽象,将目标恶意描述分解为初始帧视觉条件和时间文本指令;针对语义伪装,在图像端通过扩散采样中的受控潜空间扰动建模语义注入,并引入预训练编码器梯度引导;在文本端将提示重写为无害的“主体-动作-场景”模板,绕过安全过滤同时保留时间指引。黑盒推理阶段,两种模态协同使恶意语义随时间逐步触发。在Kling、Seedance、Veo和PixVerse等闭源商用模型上的实验表明,该方法在GPT-5.2评估下攻击成功率提升23.3%,人类评估下提升22.0%。代码已开源。

原文摘要 · Abstract (English)

In recent years, image-to-video (I2V) generation models have made remarkable progress in subject consistency and temporal coherence, enabling high quality video synthesis. However, these advances also introduce new safety risks. Existing studies mainly focus on jailbreak attacks involving single frame violations, while largely overlooking the temporal dimension unique to video generation models. In this paper, we investigate three attack scenarios and uncover a temporal vulnerability in I2V systems: unsafe semantics may emerge not from a single frame, but from semantic composition over time. We further identify two key challenges in such attacks: temporal abstraction and semantic camouflage. To address these issues, we propose TempJail, a novel temporal jailbreak framework for I2V systems. For temporal abstraction, we decompose a target malicious caption into an initial frame visual condition and a temporal text instruction. For semantic camouflage, on the image side we model semantic injection as controlled latent perturbation in diffusion sampling and introduce gradient guidance from pretrained encoders. On the text side, we rewrite the caption into an innocuous ``subject-action-scene'' template that bypasses safety filters while preserving temporal guidance. In the black-box inference phase, these two modalities jointly enable malicious semantics to be gradually triggered over time. Experiments on closed-source commercial models, including Kling, Seedance, Veo and PixVerse, show that TempJail improves attack success rate over prior state-of-the-art methods by 23.3\% under GPT-5.2 evaluation and 22.0\% under human evaluation. Our codes are available at \href{https://github.com/luqi-glory/TempJail}{GitHub}.

视频生成安全攻击越狱扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。