利用相机元数据检测AI生成图像,无需依赖特定模型内部机制。
Self-Supervised AI-Generated Image Detection: A Camera Metadata Perspective
- 通过分类和排序相机元数据标签训练特征提取器。
- 在多种生成模型上实现优于现有方法的检测准确率。
- 适合需要跨模型通用性与抗干扰能力的图像真实性验证场景。
AI生成图像的泛滥给多媒体取证带来严峻挑战,但现有检测方法多依赖特定生成模型的内部假设,限制了跨模型适用性。本文提出一种自监督方法,利用交换式图像文件格式(EXIF)元数据学习数字摄影固有特征。预训练任务通过分类类别型EXIF标签(如相机型号、场景类型)和对序数/连续型标签(如焦距、光圈值)进行成对排序来训练特征提取器。基于这些由EXIF诱导的特征,首先采用高斯混合模型建模真实照片分布,将低似然样本标记为AI生成;进一步扩展为二分类检测,将学习到的提取器作为同架构分类器的强正则化项,作用于空间打乱块的高频残差。大量实验表明,该方法在多种生成模型下显著超越现有技术,对真实世界样本具有强泛化能力,并对常见无害图像扰动保持鲁棒性。代码与模型已公开于https://github.com/Ekko-zn/SDAIE。
原文摘要 · Abstract (English)
The proliferation of AI-generated imagery poses escalating challenges for multimedia forensics, yet many existing detectors depend on assumptions about the internals of specific generative models, limiting their cross-model applicability. We introduce a self-supervised approach for detecting AI-generated images that leverages camera metadata -- specifically exchangeable image file format (EXIF) tags -- to learn features intrinsic to digital photography. Our pretext task trains a feature extractor solely on camera-captured photographs by classifying categorical EXIF tags (\emph{e.g.}, camera model and scene type) and pairwise-ranking ordinal and continuous EXIF tags (\emph{e.g.}, focal length and aperture value). Using these EXIF-induced features, we first perform one-class detection by modeling the distribution of photographic images with a Gaussian mixture model and flagging low-likelihood samples as AI-generated. We then extend to binary detection that treats the learned extractor as a strong regularizer for a classifier of the same architecture, operating on high-frequency residuals from spatially scrambled patches. Extensive experiments across various generative models demonstrate that our EXIF-induced detectors substantially advance the state of the art, delivering strong generalization to in-the-wild samples and robustness to common benign image perturbations. The code and model are publicly available at https://github.com/Ekko-zn/SDAIE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。