提出可盲提取的视频生成水印框架,兼顾高效与抗干扰能力
SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusion
- 用全局帧级伪随机密钥生成带水印初始噪声,实现无须存储密钥对的盲提取
- 在时空扰动下仍保持高比特准确率,误码率低于0.5%且计算开销极小
- 专为因果3D VAE设计,适合大规模视频生成模型的安全溯源
人工智能生成内容(AIGC)尤其是基于扩散模型的视频生成技术发展迅速。隐写水印是保护AI生成视频、追踪有害内容的关键技术,对AI安全至关重要。现有非盲式生成中水印方法需存储大量消息-密钥对并进行模板匹配,计算成本过高;且在采用因果3D变分自编码器(VAEs)的现代视频扩散模型中,对时间扰动的鲁棒性极差。为此,我们提出SIGMark:一种可盲提取的可扩展生成中水印框架。通过引入全局帧级伪随机编码密钥(GF-PRC),在不存储密钥对的前提下生成带水印初始噪声,维持噪声分布多样性并实现无损水印。进一步设计适配因果3D VAE的分段组序模块(SGO),提升提取时对时间扰动的鲁棒性。在现代扩散模型上的全面实验表明,SIGMark在时空扰动下仍能实现极高比特准确率,误码率低于0.5%,且开销极小,具备良好可扩展性。项目开源地址:https://jeremyzhao1998.github.io/SIGMark-release/
原文摘要 · Abstract (English)
Artificial Intelligence Generated Content (AIGC), particularly video generation with diffusion models, has been advanced rapidly. Invisible watermarking is a key technology for protecting AI-generated videos and tracing harmful content, and thus plays a crucial role in AI safety. Beyond post-processing watermarks which inevitably degrade video quality, recent studies have proposed distortion-free in-generation watermarking for video diffusion models. However, existing in-generation approaches are non-blind: they require maintaining all the message-key pairs and performing template-based matching during extraction, which incurs prohibitive computational costs at scale. Moreover, when applied to modern video diffusion models with causal 3D Variational Autoencoders (VAEs), their robustness against temporal disturbance becomes extremely weak. To overcome these challenges, we propose SIGMark, a Scalable In-Generation watermarking framework with blind extraction for video diffusion. To achieve blind-extraction, we propose to generate watermarked initial noise using a Global set of Frame-wise PseudoRandom Coding keys (GF-PRC), reducing the cost of storing large-scale information while preserving noise distribution and diversity for distortion-free watermarking. To enhance robustness, we further design a Segment Group-Ordering module (SGO) tailored to causal 3D VAEs, ensuring robust watermark inversion during extraction under temporal disturbance. Comprehensive experiments on modern diffusion models show that SIGMark achieves very high bit-accuracy during extraction under both temporal and spatial disturbances with minimal overhead, demonstrating its scalability and robustness. Our project is available at https://jeremyzhao1998.github.io/SIGMark-release/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。