arXiv:2412.05897cs.CVcs.AI2024-12NeurIPS被引 3

利用模型不确定性检测生成图像,提升AI内容安全识别能力

Epistemic Uncertainty for Generated Image Detection

  • 用预训练视觉模型估算图像的信念不确定性,高不确定性即为生成图像
  • 在多个数据集上准确率超90%,对未知生成模型仍有强鲁棒性
  • 适合关注AI内容安全、伪造检测的研究者与应用开发者

我们提出一种基于信念不确定性的新型AI生成图像检测框架,旨在应对生成模型带来的安全挑战。核心思路是:训练数据与测试数据分布差异会在模型的信念不确定性空间中显现显著特征。当以自然图像训练的模型评估生成图像时,会产生更高的信念不确定性。因此,我们将生成图像检测转化为不确定性估计问题,并利用在大规模自然图像上预训练的先进视觉模型进行不确定性估计。这些模型具备良好的泛化能力,可有效识别出高不确定性图像作为生成内容。大量实验验证了该方法的有效性,在多个数据集上检测准确率超过90%,且对未见过的生成模型仍具鲁棒性。代码已开源:https://github.com/tmlr-group/WePe。

原文摘要 · Abstract (English)

We introduce a novel framework for AI-generated image detection through epistemic uncertainty, aiming to address critical security concerns in the era of generative models. Our key insight stems from the observation that distributional discrepancies between training and testing data manifest distinctively in the epistemic uncertainty space of machine learning models. In this context, the distribution shift between natural and generated images leads to elevated epistemic uncertainty in models trained on natural images when evaluating generated ones. Hence, we exploit this phenomenon by using epistemic uncertainty as a proxy for detecting generated images. This converts the challenge of generated image detection into the problem of uncertainty estimation, underscoring the generalization performance of the model used for uncertainty estimation. Fortunately, advanced large-scale vision models pre-trained on extensive natural images have shown excellent generalization performance for various scenarios. Thus, we utilize these pre-trained models to estimate the epistemic uncertainty of images and flag those with high uncertainty as generated. Extensive experiments demonstrate the efficacy of our method. Code is available at https://github.com/tmlr-group/WePe.

图像检测不确定性生成内容安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。