通过机器遗忘机制,让大模型更易忘记生成图像特征,提升检测能力。
Generated Images Are Easier to Forget: A Machine Unlearning Perspective for Synthetic Image Detection

- 利用大模型在遗忘过程中的差异性,加速对生成图像的特征消退。
- 在多个数据集上,新方法检测准确率显著优于传统方法。
- 适合需要无数据训练或高效更新检测模型的研究者使用。
稳健的生成图像检测对防范生成模型滥用至关重要。现有方法主要依赖人工标注数据集,泛化能力受限。相比之下,大规模视觉模型(LVMs)在网页级数据上预训练,具备出色的泛化能力,为该任务带来变革性范式。然而实验发现,这些模型在自然图像主导的数据上预训练后,能同时捕捉自然与生成图像的特征,导致两者损失值相近,难以区分。这引发关键问题:大模型在学习自然与生成图像特征时的行为差异何时及如何显现?研究揭示:在遗忘过程中,生成图像的特征退化速度远快于自然图像。基于此,提出两种检测方法:1)无需数据的检测,通过剪枝参数诱导遗忘;2)有数据的检测,优化模型以遗忘与生成图像相关的知识。大量实验证明,基于遗忘的方法优于传统检测手段。本工作将检测任务重新定义为机器遗忘问题,建立了一种新型生成图像检测范式。
原文摘要 · Abstract (English)
Robust detection of generated images is critical to counter the misuse of generative models. Existing methods primarily depend on learning from human-annotated training datasets, limiting their generalization to unseen distributions. In contrast, large-scale vision models (LVMs) pre-trained on web-scale datasets exhibit exceptional generalization power through exposure to diverse distributions, offering a transformative paradigm for this task. However, our experimental results reveal that LVMs pre-trained on natural-image-dominated data can effectively capture the features of both natural and generated images, yielding comparably low losses and thus limited discriminative capacity between them. This prompts a key question: When and how do LVMs exhibit different behaviors when capturing features of natural and generated images? This investigation reveals an insight: during unlearning, LVMs exhibit disparate forgetting dynamics with feature degradation for generated images escalating faster than natural ones. Inspired by the disparate dynamics, we introduce two detection methods: 1) data-free detection, which prunes model parameters to induce unlearning without data access, and 2) data-driven detection, which optimizes LVMs to unlearn knowledge tied to generated images. Extensive experiments conducted on various benchmarks demonstrate that our unlearning-based approach outperforms conventional detection methods. By recasting the detection task as a problem of machine unlearning, our work establishes a new paradigm for generated image detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。