arXiv:2410.21665cs.CV2024-10ICLR被引 25

发现扩散模型局部记忆的异常信号,可精准定位复制内容。

Exploring Local Memorization in Diffusion Models via Bright Ending Attention

  • 通过分析最后步注意力模式,识别出局部记忆的'亮终点'特征。
  • 在多个数据集上实现90%以上的局部记忆区域定位准确率。
  • 适用于版权检测与生成安全审查,适合模型开发者使用。

文本到图像扩散模型在生成真实感图像方面取得了前所未有的进展,但其在推理过程中倾向于记忆并复制训练数据,引发版权侵权等重大问题。现有方法在处理局部记忆(仅特定图像区域被复制)时表现显著不足,且无法定位记忆区域。本文揭示了一种新型的“亮终点”(Bright Ending, BE)异常现象:在扩散模型的最后推理步骤中,被记忆的图像块对最后一个文本标记的注意力显著高于未被记忆的块。该特征可有效标识出生成图像中复制训练数据的区域,并实现高效定位。基于此,我们提出一种简单而有效的集成方法,将BE机制融入现有框架,显著缩小了局部记忆导致的性能差距。实验结果不仅验证了新定位任务的成功,还在所有现有任务中达到新的最先进水平,凸显了BE现象的重要性。

原文摘要 · Abstract (English)

Text-to-image diffusion models have achieved unprecedented proficiency in generating realistic images. However, their inherent tendency to memorize and replicate training data during inference raises significant concerns, including potential copyright infringement. In response, various methods have been proposed to evaluate, detect, and mitigate memorization. Our analysis reveals that existing approaches significantly underperform in handling local memorization, where only specific image regions are memorized, compared to global memorization, where the entire image is replicated. Also, they cannot locate the local memorization regions, making it hard to investigate locally. To address these, we identify a novel "bright ending" (BE) anomaly in diffusion models prone to memorizing training images. BE refers to a distinct cross-attention pattern observed in text-to-image diffusion models, where memorized image patches exhibit significantly greater attention to the final text token during the last inference step than non-memorized patches. This pattern highlights regions where the generated image replicates training data and enables efficient localization of memorized regions. Equipped with this, we propose a simple yet effective method to integrate BE into existing frameworks, significantly improving their performance by narrowing the performance gap caused by local memorization. Our results not only validate the successful execution of the new localization task but also establish new state-of-the-art performance across all existing tasks, underscoring the significance of the BE phenomenon.

扩散模型局部记忆注意力分析版权检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。