arXiv:2410.05470cs.CRcs.AI2024-10ICLR被引 56

用可控扩散模型从干净噪声重生成图像,可有效移除主流图像水印。

Image Watermarks are Removable Using Controllable Regeneration from Clean Noise

  • 从干净噪声出发,通过语义与空间控制重建图像
  • 在水印清除率与图像质量间实现平滑权衡
  • 适用于需要移除水印的研究者或内容创作者

图像水印技术在大模型时代对版权保护、防滥用和溯源至关重要。本文提出一种新型水印移除方法,通过可控扩散模型从干净高斯噪声出发,利用水印图像中提取的语义与空间特征进行重生成。特别设计的语义控制适配器与空间控制网络,可精确调控去噪过程,保证图像质量并提升复原一致性。为实现水印清除效果与图像一致性的平衡,引入可调节的再生机制:对水印图像的潜在表示添加不同数量的噪声步数,再从该噪声潜码开始可控去噪。随着噪声步数增加,潜在表示逐步趋近于纯净高斯噪声,从而实现灵活权衡。实验表明,该方法在多种水印技术上均优于现有重生成方案,在视觉一致性和水印清除能力方面表现更优。代码已开源:https://github.com/yepengliu/CtrlRegen。

原文摘要 · Abstract (English)

Image watermark techniques provide an effective way to assert ownership, deter misuse, and trace content sources, which has become increasingly essential in the era of large generative models. A critical attribute of watermark techniques is their robustness against various manipulations. In this paper, we introduce a watermark removal approach capable of effectively nullifying state-of-the-art watermarking techniques. Our primary insight involves regenerating the watermarked image starting from a clean Gaussian noise via a controllable diffusion model, utilizing the extracted semantic and spatial features from the watermarked image. The semantic control adapter and the spatial control network are specifically trained to control the denoising process towards ensuring image quality and enhancing consistency between the cleaned image and the original watermarked image. To achieve a smooth trade-off between watermark removal performance and image consistency, we further propose an adjustable and controllable regeneration scheme. This scheme adds varying numbers of noise steps to the latent representation of the watermarked image, followed by a controlled denoising process starting from this noisy latent representation. As the number of noise steps increases, the latent representation progressively approaches clean Gaussian noise, facilitating the desired trade-off. We apply our watermark removal methods across various watermarking techniques, and the results demonstrate that our methods offer superior visual consistency/quality and enhanced watermark removal performance compared to existing regeneration approaches. Our code is available at https://github.com/yepengliu/CtrlRegen.

图像水印扩散模型可控生成版权保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。