arXiv:2512.09687cs.CV2025-12被引 1

通过剪枝特定模块,无须识别记忆内容即可抑制生成模型版权内容。

Unconsciously Forget: Mitigating Memorization; Without Knowing What is being Memorized

  • 定位并剪枝负责版权内容生成的模型组件
  • 剪枝后生成版权内容概率显著下降,且保持整体生成能力
  • 方法通用且可与现有去记忆技术结合使用

生成模型虽能产出高度逼真的图像,但常复现训练数据,尤其在模型规模增大时更为严重。这种记忆现象可能导致版权、肖像权及商标侵权问题。现有方法多通过调整去噪采样过程或需针对特定概念进行再训练,但存在计算开销大、适用范围窄等局限。本文提出UniForget,揭示模型中特定部分主导版权内容生成,并通过模型剪枝有效抑制此类内容生成,无需预先识别被记忆的具体概念,同时保留模型通用生成能力。实验表明该方法与现有去记忆技术正交且互补,具有提升当前去记忆技术的潜力。

原文摘要 · Abstract (English)

Recent advances in generative models have demonstrated an exceptional ability to produce highly realistic images. However, previous studies show that generated images often resemble the training data, and this problem becomes more severe as the model size increases. Memorizing training data can lead to legal challenges, including copyright infringement, violations of portrait rights, and trademark violations. Existing approaches to mitigating memorization mainly focus on manipulating the denoising sampling process to steer image embeddings away from the memorized embedding space or employ unlearning methods that require training on datasets containing specific sets of memorized concepts. However, existing methods often incur substantial computational overhead during sampling, or focus narrowly on removing one or more groups of target concepts, imposing a significant limitation on their scalability. To understand and mitigate these problems, our work, UniForget, offers a new perspective on understanding the root cause of memorization. Our work demonstrates that specific parts of the model are responsible for copyrighted content generation. By applying model pruning, we can effectively suppress the probability of generating copyrighted content without targeting specific concepts while preserving the general generative capabilities of the model. Additionally, we show that our approach is both orthogonal and complementary to existing unlearning methods, thereby highlighting its potential to improve current unlearning and de-memorization techniques.

生成模型去记忆模型剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。