arXiv:2501.14195cs.CV2025-01ICLR被引 35

视频生成时嵌入水印,可检测篡改且不降质

VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking

  • 生成时直接嵌入水印,无需额外训练
  • 能精准定位时间与空间上的篡改痕迹
  • 适用于视频和图像生成,开源可用

人工智能生成内容(AIGC)在视频生成模型如文本到视频(T2V)和图像到视频(I2V)方面取得显著进展。然而,视频生成仍需强有力的可控性。当前主流水印方法多针对图像,对视频关注不足。传统逐帧后处理方式常导致画质下降。本文提出 VideoShield,一种专为扩散模型设计的视频水印框架。该方法在生成过程中直接嵌入水印,无需额外训练。为保障视频完整性,引入时空篡改定位功能。通过将水印位映射至模板位,在去噪过程中生成含水印的噪声。利用 DDIM 反演可还原原始含水印噪声,实现水印提取。模板位还可用于精确检测时间与空间篡改。在多种视频模型(包括 T2V 与 I2V)上的实验表明,本方法有效提取水印并检测篡改,且不损害视频质量。此外,该方法亦适用于图像生成模型,实现生成图像的篡改检测。代码与模型已开源。

原文摘要 · Abstract (English)

Artificial Intelligence Generated Content (AIGC) has advanced significantly, particularly with the development of video generation models such as text-to-video (T2V) models and image-to-video (I2V) models. However, like other AIGC types, video generation requires robust content control. A common approach is to embed watermarks, but most research has focused on images, with limited attention given to videos. Traditional methods, which embed watermarks frame-by-frame in a post-processing manner, often degrade video quality. In this paper, we propose VideoShield, a novel watermarking framework specifically designed for popular diffusion-based video generation models. Unlike post-processing methods, VideoShield embeds watermarks directly during video generation, eliminating the need for additional training. To ensure video integrity, we introduce a tamper localization feature that can detect changes both temporally (across frames) and spatially (within individual frames). Our method maps watermark bits to template bits, which are then used to generate watermarked noise during the denoising process. Using DDIM Inversion, we can reverse the video to its original watermarked noise, enabling straightforward watermark extraction. Additionally, template bits allow precise detection for potential temporal and spatial modification. Extensive experiments across various video models (both T2V and I2V models) demonstrate that our method effectively extracts watermarks and detects tamper without compromising video quality. Furthermore, we show that this approach is applicable to image generation models, enabling tamper detection in generated images as well. Codes and models are available at https://github.com/hurunyi/VideoShield.

视频生成水印技术扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。