T2SMark让扩散模型水印既抗干扰又保多样性。
T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models
- 用尾部截断采样法,只在可靠区域嵌入水印比特。
- 在多种模型上验证,水印检测率超95%且生成图像质量高。
- 适合需要版权保护的AI图像生成场景,如商业创作。
近年来,扩散模型快速发展,生成高质量图像的同时引发知识产权保护与生成式AI滥用问题。针对扩散模型的图像水印技术,尤其是噪声即水印(NaW)方法,通过特定标准高斯噪声向量编码水印信息,在生成过程中无缝嵌入并保持图像质量;检测时逆向生成过程以恢复初始噪声向量并提取水印。然而,现有NaW方法难以兼顾水印鲁棒性与生成多样性:部分方法通过严格限制初始噪声采样获得强鲁棒性,但损害用户体验;另一些方法虽保留多样性,却在真实场景中过于脆弱。为此,本文提出T2SMark,一种基于尾部截断采样(TTS)的两阶段水印方案。不同于以往简单将比特映射为正负值的方法,TTS仅在可靠尾部区域嵌入比特,同时随机采样中心区域以维持潜在分布。两阶段框架进一步通过引入随机会话密钥,集成至加密流程中,确保采样多样性。我们在采用U-Net和DiT骨干网络的扩散模型上评估T2SMark。大量实验表明,该方法实现了鲁棒性与多样性的最优平衡。代码已公开于https://github.com/0xD009/T2SMark。
原文摘要 · Abstract (English)
Diffusion models have advanced rapidly in recent years, producing high-fidelity images while raising concerns about intellectual property protection and the misuse of generative AI. Image watermarking for diffusion models, particularly Noise-as-Watermark (NaW) methods, encode watermark as specific standard Gaussian noise vector for image generation, embedding the infomation seamlessly while maintaining image quality. For detection, the generation process is inverted to recover the initial noise vector containing the watermark before extraction. However, existing NaW methods struggle to balance watermark robustness with generation diversity. Some methods achieve strong robustness by heavily constraining initial noise sampling, which degrades user experience, while others preserve diversity but prove too fragile for real-world deployment. To address this issue, we propose T2SMark, a two-stage watermarking scheme based on Tail-Truncated Sampling (TTS). Unlike prior methods that simply map bits to positive or negative values, TTS enhances robustness by embedding bits exclusively in the reliable tail regions while randomly sampling the central zone to preserve the latent distribution. Our two-stage framework then ensures sampling diversity by integrating a randomly generated session key into both encryption pipelines. We evaluate T2SMark on diffusion models with both U-Net and DiT backbones. Extensive experiments show that it achieves an optimal balance between robustness and diversity. Our code is available at \href{https://github.com/0xD009/T2SMark}{https://github.com/0xD009/T2SMark}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。