arXiv:2504.14933cs.CV2025-04

用分割掩码两步生成,防止扩散模型抄袭原图。

TWIG: Two-Step Image Generation using Segmentation Masks in Diffusion Models

  • 先生成图像掩码,再用掩码引导重生成。
  • 结构相似度显著降低,有效避免源图复制。
  • 无需重训练或改提示词,计算成本低。

在社交媒体和营销领域,版权问题严重阻碍图像的自由共享。生成式AI虽能创建高质量图像,但因训练数据来自真实图片,常引发版权争议,甚至直接复制受版权保护的内容(称作源复制)。传统水印、元数据等保护手段对此无效。为此,我们提出一种受条件扩散模型启发的两步图像生成方法:首先基于提示词生成图像并提取其分割掩码,该掩码表征图像形状;随后利用扩散模型在生成新图像时避开该形状。实验表明,此方法显著降低生成图像与训练图像之间的结构相似性,有效缓解源复制问题。该方法无需昂贵的模型重训练或用户定制提示词,是当前最轻量级的扩散模型版权防护方案。

原文摘要 · Abstract (English)

In today's age of social media and marketing, copyright issues can be a major roadblock to the free sharing of images. Generative AI models have made it possible to create high-quality images, but concerns about copyright infringement are a hindrance to their abundant use. As these models use data from training images to generate new ones, it is often a daunting task to ensure they do not violate intellectual property rights. Some AI models have even been noted to directly copy copyrighted images, a problem often referred to as source copying. Traditional copyright protection measures such as watermarks and metadata have also proven to be futile in this regard. To address this issue, we propose a novel two-step image generation model inspired by the conditional diffusion model. The first step involves creating an image segmentation mask for some prompt-based generated images. This mask embodies the shape of the image. Thereafter, the diffusion model is asked to generate the image anew while avoiding the shape in question. This approach shows a decrease in structural similarity from the training image, i.e. we are able to avoid the source copying problem using this approach without expensive retraining of the model or user-centered prompt generation techniques. This makes our approach the most computationally inexpensive approach to avoiding both copyright infringement and source copying for diffusion model-based image generation.

扩散模型版权防护图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。