arXiv:2412.04653cs.CVcs.AI2024-12ICLR被引 28

利用扩散模型初始噪声实现无损图像水印,抗伪造能力更强。

Hidden in the Noise: Two-Stage Robust Watermarking for Images

  • 用扩散模型初始噪声做水印,不改变图像分布
  • 通过傅里叶模式分组嵌入水印信息,提升检测效率
  • 对多种篡改攻击保持鲁棒性,适合负责任生成内容

随着图像生成质量持续提升,深度伪造引发广泛社会关注。图像水印可帮助模型所有者检测并标记其生成内容,减轻潜在危害。然而,现有先进水印方法仍易受伪造和移除攻击。这部分源于水印会扭曲生成图像的分布,无意中暴露水印技术信息。本文首次提出基于扩散模型初始噪声的无损水印方法。但检测需对比重建的初始噪声与所有历史噪声。为此,我们设计两阶段水印框架:生成时,将傅里叶模式嵌入初始噪声,标识所用噪声组;检测时,(i)检索相关噪声组,(ii)在组内搜索匹配的初始噪声。该方法在多项攻击测试中达到当前最优鲁棒性。

原文摘要 · Abstract (English)

As the quality of image generators continues to improve, deepfakes become a topic of considerable societal debate. Image watermarking allows responsible model owners to detect and label their AI-generated content, which can mitigate the harm. Yet, current state-of-the-art methods in image watermarking remain vulnerable to forgery and removal attacks. This vulnerability occurs in part because watermarks distort the distribution of generated images, unintentionally revealing information about the watermarking techniques. In this work, we first demonstrate a distortion-free watermarking method for images, based on a diffusion model's initial noise. However, detecting the watermark requires comparing the initial noise reconstructed for an image to all previously used initial noises. To mitigate these issues, we propose a two-stage watermarking framework for efficient detection. During generation, we augment the initial noise with generated Fourier patterns to embed information about the group of initial noises we used. For detection, we (i) retrieve the relevant group of noises, and (ii) search within the given group for an initial noise that might match our image. This watermarking approach achieves state-of-the-art robustness to forgery and removal against a large battery of attacks.

图像水印扩散模型鲁棒性防伪造

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。