用少量样本快速识别并溯源伪造图像,应对生成模型迭代快的挑战。
Supervised Contrastive Learning for Few-Shot AI-Generated Image Detection and Attribution
- 先用监督对比学习训练模型提取图像特征,再用近邻分类器做少样本检测。
- 仅需每类150张图,检测准确率达91.3%,比现有方法高5.2个百分点。
- 适合需要快速适配新生成模型的数字取证场景,无需频繁重训练。
生成式人工智能的快速发展使合成图像日益逼近真实内容,严重威胁数字媒体真实性。新型生成模型迭代加速,传统依赖周期性重训练的检测方法在计算和操作上均难以为继。本文提出一种两阶段检测框架以解决合成图像检测中的泛化难题。第一阶段采用监督对比学习训练视觉深度模型,从输入图像中提取判别性嵌入;训练时刻意排除部分生成模型架构,以严格评估跨模型泛化能力。第二阶段在学习到的嵌入空间中使用少样本学习范式的k-NN分类器,仅需每类150张来自未知生成模型的样本即可完成训练。该框架在检测任务中平均准确率达91.3%,较现有方法提升5.2个百分点;在源归属任务中,开放集分类下的AUC与OSCR分别提升14.70%和4.27%,显著推进了无需频繁重训练即可适应动态生成模型环境的鲁棒、可扩展的数字取证系统发展。
原文摘要 · Abstract (English)
The rapid advancement of generative artificial intelligence has enabled the creation of synthetic images that are increasingly indistinguishable from authentic content, posing significant challenges for digital media integrity. This problem is compounded by the accelerated release cycle of novel generative models, which renders traditional detection approaches (reliant on periodic retraining) computationally infeasible and operationally impractical. This work proposes a novel two-stage detection framework designed to address the generalization challenge inherent in synthetic image detection. The first stage employs a vision deep learning model trained via supervised contrastive learning to extract discriminative embeddings from input imagery. Critically, this model was trained on a strategically partitioned subset of available generators, with specific architectures withheld from training to rigorously ablate cross-generator generalization capabilities. The second stage utilizes a k-nearest neighbors (k-NN) classifier operating on the learned embedding space, trained in a few-shot learning paradigm incorporating limited samples from previously unseen test generators. With merely 150 images per class in the few-shot learning regime, which are easily obtainable from current generation models, the proposed framework achieves an average detection accuracy of 91.3%, representing a 5.2 percentage point improvement over existing approaches . For the source attribution task, the proposed approach obtains improvements of of 14.70% and 4.27% in AUC and OSCR respectively on an open set classification context, marking a significant advancement toward robust, scalable forensic attribution systems capable of adapting to the evolving generative AI landscape without requiring exhaustive retraining protocols.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。