无需训练即可为自回归图像生成模型嵌入不可见水印
Training-Free Watermarking for Autoregressive Image Generation
- 利用码本中索引的冗余性,通过替换相似索引嵌入水印
- 在保持图像质量的前提下,验证准确率超95%,抗多种攻击
- 适合需要快速部署水印保护的图像生成系统
不可见图像水印可保护图像版权并防止视觉生成模型被恶意滥用。然而,现有生成式水印方法主要针对扩散模型,而自回归图像生成模型的水印研究仍不充分。本文提出IndexMark,一种面向自回归图像生成模型的无训练水印框架。该方法基于码本索引的冗余特性:将自回归生成的索引替换为语义相近的索引,对视觉效果影响极小。核心是‘匹配-替换’策略,根据索引相似度从码本中选取水印索引,并通过替换方式嵌入水印,不影响图像质量。水印验证通过计算生成图像中水印索引的比例实现,进一步结合索引编码器提升精度。此外引入辅助验证机制,增强对裁剪攻击的鲁棒性。实验表明,IndexMark在图像质量与验证准确率上均达到当前最优水平,对裁剪、噪声、高斯模糊、随机擦除、色彩抖动及JPEG压缩等多种扰动具有强鲁棒性。
原文摘要 · Abstract (English)
Invisible image watermarking can protect image ownership and prevent malicious misuse of visual generative models. However, existing generative watermarking methods are mainly designed for diffusion models while watermarking for autoregressive image generation models remains largely underexplored. We propose IndexMark, a training-free watermarking framework for autoregressive image generation models. IndexMark is inspired by the redundancy property of the codebook: replacing autoregressively generated indices with similar indices produces negligible visual differences. The core component in IndexMark is a simple yet effective match-then-replace method, which carefully selects watermark tokens from the codebook based on token similarity, and promotes the use of watermark tokens through token replacement, thereby embedding the watermark without affecting the image quality. Watermark verification is achieved by calculating the proportion of watermark tokens in generated images, with precision further improved by an Index Encoder. Furthermore, we introduce an auxiliary validation scheme to enhance robustness against cropping attacks. Experiments demonstrate that IndexMark achieves state-of-the-art performance in terms of image quality and verification accuracy, and exhibits robustness against various perturbations, including cropping, noises, Gaussian blur, random erasing, color jittering, and JPEG compression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。