arXiv:2601.20642cs.LGcs.AI2026-01中稿 · ICLR被引 3

发现扩散模型记忆现象的新检测方法,速度快且无需去噪步骤。

Detecting and Mitigating Memorization in Diffusion Models through Anisotropy of the Log-Probability

  • 基于对数概率各向异性设计新检测指标,捕捉低噪声下的记忆特征。
  • 在Stable Diffusion v1.4/v2上优于现有无去噪方法,提速超5倍。
  • 适用于需要快速评估生成模型隐私风险的研究与应用者。

基于扩散的图像生成模型通过迭代去噪生成高质量图像,但仍存在记忆问题,即无意中复现训练图像的完整或局部内容。现有记忆检测方法主要依赖得分差值范数作为指标,但我们证明该指标仅在对数概率分布各向同性时有效,通常适用于高或中等噪声水平。而在低噪声条件下,记忆样本表现出引导向量与无条件得分之间的强角度对齐。基于此,我们提出融合各向同性范数与各向异性对齐的新检测指标。该指标可通过对纯噪声输入进行两次前向传播(有条件与无条件)直接计算,无需耗时的去噪过程。在Stable Diffusion v1.4和v2上的检测实验表明,本方法优于现有无去噪检测方法,且速度至少比当前最优方案快约5倍。最后,我们通过基于该指标自适应调整提示词的缓解策略,验证了方法有效性。代码已开源:https://github.com/rohanasthana/memorization-anisotropy。

原文摘要 · Abstract (English)

Diffusion-based image generative models produce high-fidelity images through iterative denoising but remain vulnerable to memorization, where they unintentionally reproduce exact copies or parts of training images. Recent memorization detection methods are primarily based on the norm of score difference as indicators of memorization. We prove that such norm-based metrics are mainly effective under the assumption of isotropic log-probability distributions, which generally holds at high or medium noise levels. In contrast, analyzing the anisotropic regime reveals that memorized samples exhibit strong angular alignment between the guidance vector and unconditional scores in the low-noise setting. Through these insights, we develop a memorization detection metric by integrating isotropic norm and anisotropic alignment. Our detection metric can be computed directly on pure noise inputs via two conditional and unconditional forward passes, eliminating the need for costly denoising steps. Detection experiments on Stable Diffusion v1.4 and v2 show that our metric outperforms existing denoising-free detection methods while being at least approximately 5x faster than the previous best approach. Finally, we demonstrate the effectiveness of our approach by utilizing a mitigation strategy that adapts memorized prompts based on our developed metric. The code is available at https://github.com/rohanasthana/memorization-anisotropy .

扩散模型记忆检测隐私安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。