用自编码器的上下文重建能力检测AI生成图像,准确率超93%。
Detecting AI-Generated Images via Contextual Anomaly Estimation in Masked AutoEncoders
- 基于掩码自编码器的上下文重建生成异常信号
- 在GenImage和AIGCDetectBenchmark上分别达96.63%和93.96%准确率
- 适合需要高鲁棒性图像检测的研究者或安全应用
基于上下文的检测方法(如DetectGPT)通过评估内容与模型学习分布的一致性,在识别AI生成文本方面表现出强泛化能力。相比之下,现有图像检测器依赖预训练主干网络(如CLIP)提取的判别特征,隐式捕捉生成器特有的伪影。然而,随着现代生成模型视觉保真度快速提升,这些检测器所依赖的伪影变得越来越细微甚至消失,降低了其可靠性。掩码自编码器(MAE)在训练中自然地从可见上下文重建被遮蔽区域,建模了像素级上下文合理性,类似条件概率估计,同时其编码器可作为强大的语义特征提取器。我们提出CINEMAE,一种新架构,同时利用MAE的双重能力:从重建机制中提取逐块异常信号,并从编码器中提取全局语义特征,融合上下文与特征线索实现鲁棒检测。CINEMAE在GenImage上达到96.63%的平均准确率,在AIGCDetectBenchmark上为93.96%,即使在JPEG压缩质量因子50下仍保持超过93%的准确率。
原文摘要 · Abstract (English)
Context-based detection methods such as DetectGPT achieve strong generalization in identifying AI-generated text by evaluating content compatibility with a model's learned distribution. In contrast, existing image detectors rely on discriminative features from pretrained backbones such as CLIP, which implicitly capture generator-specific artifacts. However, as modern generative models rapidly advance in visual fidelity, the artifacts these detectors depend on are becoming increasingly subtle or absent, undermining their reliability. Masked AutoEncoders (MAE) are inherently trained to reconstruct masked patches from visible context, naturally modeling patch-level contextual plausibility akin to conditional probability estimation, while also serving as a powerful semantic feature extractor through its encoder. We propose CINEMAE, a novel architecture that exploits both capabilities of MAE for AI-generated image detection: we derive per-patch anomaly signals from the reconstruction mechanism and extract global semantic features from the encoder, fusing both context-based and feature-based cues for robust detection. CINEMAE achieves highly competitive mean accuracies of 96.63\% on GenImage and 93.96\% on AIGCDetectBenchmark, maintaining over 93\% accuracy even under JPEG compression at QF=50.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。