Video Seal实现高效视频水印,抗压缩和几何变换能力强。
Video Seal: Open and Efficient Video Watermarking
- 联合训练嵌入与提取网络,通过编码器间变换提升鲁棒性。
- 在复杂失真下比基线模型更稳定,支持逐帧高效处理。
- 开源代码模型,适合内容安全与版权保护研究者使用。
AI生成内容和高级视频编辑工具的普及使数字平台监管愈发重要且困难。视频水印通过嵌入不可感知信号实现内容识别,但现有开放工具在效率、鲁棒性和灵活性上不足。本文提出Video Seal,一个神经视频水印的完整框架及开源模型。方法联合训练嵌入器与提取器,并在中间加入视频编码等变换以增强鲁棒性,训练分多阶段进行:图像预训练、混合后训练与提取器微调。引入时间水印传播技术,可将任意图像水印模型转为高效视频水印模型,无需对每一帧高分辨率画面单独加水印。实验表明,该方法在速度、不可察觉性和鲁棒性方面表现优异,在结合几何变换与视频压缩的挑战性失真下优于强基线。还提供了关于训练中视频压缩影响及不同载荷量方法比较的新见解。本工作贡献包括代码库、模型和公开演示,均以宽松许可开源,推动领域进一步发展。
原文摘要 · Abstract (English)
The proliferation of AI-generated content and sophisticated video editing tools has made it both important and challenging to moderate digital platforms. Video watermarking addresses these challenges by embedding imperceptible signals into videos, allowing for identification. However, the rare open tools and methods often fall short on efficiency, robustness, and flexibility. To reduce these gaps, this paper introduces Video Seal, a comprehensive framework for neural video watermarking and a competitive open-sourced model. Our approach jointly trains an embedder and an extractor, while ensuring the watermark robustness by applying transformations in-between, e.g., video codecs. This training is multistage and includes image pre-training, hybrid post-training and extractor fine-tuning. We also introduce temporal watermark propagation, a technique to convert any image watermarking model to an efficient video watermarking model without the need to watermark every high-resolution frame. We present experimental results demonstrating the effectiveness of the approach in terms of speed, imperceptibility, and robustness. Video Seal achieves higher robustness compared to strong baselines especially under challenging distortions combining geometric transformations and video compression. Additionally, we provide new insights such as the impact of video compression during training, and how to compare methods operating on different payloads. Contributions in this work - including the codebase, models, and a public demo - are open-sourced under permissive licenses to foster further research and development in the field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。