arXiv:2412.09122cs.CV2024-12被引 6

为视频扩散模型设计鲁棒水印,兼顾画质与抗攻击能力

LVMark: Robust Watermark for Latent Video Diffusion Models

  • 基于时序一致性设计新型水印解码器,融合三维小波低频与色彩特征
  • 支持512比特容量水印,抗干扰能力强,解码准确率高
  • 适用于保护生成视频版权,适合内容创作者和平台方使用

视频扩散模型的快速发展催生了高度逼真的视频生成,但也引发了未经授权使用的担忧,推动了模型版权保护技术的需求。现有水印方法存在两大缺陷:传统解码器忽略时序一致性,且损害生成视频的视觉质量。为此,我们提出一种针对潜在空间视频扩散模型的鲁棒水印方法——LVMark。该方法通过学习相邻帧间的一致性,设计了专用于生成视频的新颖水印解码器,结合三维小波域低频分量与视频颜色特征,确保在恶意攻击下仍能准确解码。同时,我们训练一个潜在解码器以维持生成视频的视觉保真度,并采用基于重要性的权重调制策略,将水印嵌入对视觉影响最小的层中。通过联合优化水印解码器与扩散模型潜在解码器,有效平衡了视觉质量与比特准确性。实验表明,该方法可嵌入不可见水印,在多种失真条件下仍保持512比特容量的鲁棒解码准确率。

原文摘要 · Abstract (English)

Rapid advancements in video diffusion models have enabled the creation of realistic videos, raising concerns about unauthorized use and driving the demand for techniques to protect model ownership. Existing watermarking methods suffer from two key limitations: they overlook temporal consistency due to conventional watermark decoders and degrade the visual quality of the generated videos. To address these issues, we introduce a robust watermarking method for latent video diffusion models named Latent Video Diffusion Watermarking (LVMark). We propose a novel watermark decoder tailored for generated videos by learning the consistency between adjacent frames. It ensures accurate message decoding, even under malicious attacks, by combining the low-frequency components of the three-dimensional wavelet domain with the color features of the video. Additionally, we train a latent decoder to maintain the visual fidelity of the generated video. Watermarks are embedded into layers with minimal impact on visual appearance using an importance-based weight modulation strategy. We optimize both the watermark decoder and the latent decoder of diffusion model, effectively balancing the trade-off between visual quality and bit accuracy. Our experiments show that our method embeds invisible watermarks into video diffusion models, ensuring robust decoding accuracy with 512-bit capacity, even under distortions.

视频水印扩散模型版权保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。