arXiv:2409.19952cs.CV2024-09NeurIPS被引 7

首个专用于检测扩散模型图像复制的系统,解决生成内容原创性难题。

Image Copy Detection for Diffusion Models

  • 构建扩散模型复制数据集D-Rep,含4万对带标注复制等级的图像。
  • 提出PDF-Embedding方法,用概率密度函数监督复制程度,精度优于传统方法。
  • 发现主流扩散模型对开源图库的复制率在10%~20%,适合内容安全与版权研究者。

由扩散模型生成的图像在数字艺术和视觉营销中日益流行,但可能复现已有内容,引发原创性挑战。现有图像复制检测(ICD)模型虽能准确识别手工复制,却忽视了扩散模型带来的新问题。为此,我们提出ICDiff,首个专为扩散模型设计的ICD系统。我们构建了扩散复制数据集D-Rep,使用Stable Diffusion V1.5生成4万对图像复制对,并人工标注为6个复制等级(0至5)。我们提出PDF-Embedding方法,将每对图像的复制等级转化为概率密度函数(PDF)作为监督信号,利用相邻等级间概率应连续平滑的直觉。实验表明,该方法在D-Rep测试集上超越基于协议的方法及非PDF方案。此外,利用PDF-Embedding发现,知名扩散模型对开源图库的复制率介于10%至20%之间。项目已公开:https://icdiff.github.io/。

原文摘要 · Abstract (English)

Images produced by diffusion models are increasingly popular in digital artwork and visual marketing. However, such generated images might replicate content from existing ones and pose the challenge of content originality. Existing Image Copy Detection (ICD) models, though accurate in detecting hand-crafted replicas, overlook the challenge from diffusion models. This motivates us to introduce ICDiff, the first ICD specialized for diffusion models. To this end, we construct a Diffusion-Replication (D-Rep) dataset and correspondingly propose a novel deep embedding method. D-Rep uses a state-of-the-art diffusion model (Stable Diffusion V1.5) to generate 40, 000 image-replica pairs, which are manually annotated into 6 replication levels ranging from 0 (no replication) to 5 (total replication). Our method, PDF-Embedding, transforms the replication level of each image-replica pair into a probability density function (PDF) as the supervision signal. The intuition is that the probability of neighboring replication levels should be continuous and smooth. Experimental results show that PDF-Embedding surpasses protocol-driven methods and non-PDF choices on the D-Rep test set. Moreover, by utilizing PDF-Embedding, we find that the replication ratios of well-known diffusion models against an open-source gallery range from 10% to 20%. The project is publicly available at https://icdiff.github.io/.

图像检测扩散模型版权保护数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。