用时间一致性扰动保护视频,防被恶意编辑。
UVCG: Leveraging Temporal Consistency for Universal Video Protection
- 通过连续不可察觉的扰动嵌入目标视频内容
- 在多个LDM模型上实现高防护效果与计算效率
- 适合需要防止视频被篡改的创作者和平台
AI驱动的视频编辑安全风险日益受到关注。尽管图像扰动可抵御恶意修改,但直接对视频每帧单独扰动失效,因视频编辑技术依赖帧间信息一致性来恢复被扰动内容。为此,我们提出通用视频一致性保护机制(UVCG),通过引入连续、不可察觉的扰动,将另一视频(目标视频)内容嵌入受保护视频中。该方法迫使编辑模型编码器将连续输入映射为错位输出,从而抑制生成与文本提示一致的视频。同时利用相邻帧扰动相似性,采用扰动复用策略提升生成效率。我们在多种版本的潜在扩散模型(LDM)及多个LDM-based编辑流水线中验证了其有效性、迁移性与高效性,结果表明该方法在防范未经授权修改方面具有显著优势。
原文摘要 · Abstract (English)
The security risks of AI-driven video editing have garnered significant attention. Although recent studies indicate that adding perturbations to images can protect them from malicious edits, directly applying image-based methods to perturb each frame in a video becomes ineffective, as video editing techniques leverage the consistency of inter-frame information to restore individually perturbed content. To address this challenge, we leverage the temporal consistency of video content to propose a straightforward and efficient, yet highly effective and broadly applicable approach, Universal Video Consistency Guard (UVCG). UVCG embeds the content of another video(target video) within a protected video by introducing continuous, imperceptible perturbations which has the ability to force the encoder of editing models to map continuous inputs to misaligned continuous outputs, thereby inhibiting the generation of videos consistent with the intended textual prompts. Additionally leveraging similarity in perturbations between adjacent frames, we improve the computational efficiency of perturbation generation by employing a perturbation-reuse strategy. We applied UVCG across various versions of Latent Diffusion Models (LDM) and assessed its effectiveness and generalizability across multiple LDM-based editing pipelines. The results confirm the effectiveness, transferability, and efficiency of our approach in safeguarding video content from unauthorized modifications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。