区分生成图像的不确定性,提升检测准确率。
Diffusion Epistemic Uncertainty with Asymmetric Learning for Diffusion-Generated Image Detection
- 用拉普拉斯近似估计扩散模型的认知不确定性
- 设计非对称损失函数,使分类器更鲁棒
- 适合关注生成内容安全与可信性的研究者
扩散模型的快速发展使得检测生成图像的需求日益迫切。已有研究表明,引入基于扩散的度量(如重构误差)可提升检测器的泛化能力。然而,忽略偶然性不确定性与认知不确定性在重构误差中的不同影响,会削弱检测性能。偶然性不确定性源于数据固有的噪声,造成识别模糊,无法帮助区分生成图像;而认知不确定性反映模型对陌生模式的知识缺失,有助于检测。本文提出一种新框架——扩散认知不确定性与非对称学习(DEUA),通过拉普拉斯近似估计扩散生成样本流形附近的认知不确定性(DEU),并引入非对称损失函数训练具有更大分类边距的平衡分类器,进一步提升泛化能力。大规模基准测试验证了该方法的先进性能。
原文摘要 · Abstract (English)
The rapid progress of diffusion models highlights the growing need for detecting generated images. Previous research demonstrates that incorporating diffusion-based measurements, such as reconstruction error, can enhance the generalizability of detectors. However, ignoring the differing impacts of aleatoric and epistemic uncertainty on reconstruction error can undermine detection performance. Aleatoric uncertainty, arising from inherent data noise, creates ambiguity that impedes accurate detection of generated images. As it reflects random variations within the data (e.g., noise in natural textures), it does not help distinguish generated images. In contrast, epistemic uncertainty, which represents the model's lack of knowledge about unfamiliar patterns, supports detection. In this paper, we propose a novel framework, Diffusion Epistemic Uncertainty with Asymmetric Learning~(DEUA), for detecting diffusion-generated images. We introduce Diffusion Epistemic Uncertainty~(DEU) estimation via the Laplace approximation to assess the proximity of data to the manifold of diffusion-generated samples. Additionally, an asymmetric loss function is introduced to train a balanced classifier with larger margins, further enhancing generalizability. Extensive experiments on large-scale benchmarks validate the state-of-the-art performance of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。