用图像质量评估模型的感知特征,高效识别生成图像。
Perceptual Classifiers: Detecting Generative Images using Perceptual Features
- 利用现有图像质量评估模型提取感知特征
- 两层网络在跨模型检测中表现领先,准确率超95%
- 对图像降质有强鲁棒性,适合真实场景应用
图像质量评估(IQA)模型广泛应用于图像与视频处理流程中,以降低存储开销、减少传输成本并提升数百万用户的观看体验。这些模型对多种图像失真敏感,能准确预测人类主观评价的图像质量。随着生成模型的发展,互联网上出现了大量“生成式AI”内容。现有检测方法在未见生成模型上的泛化性能已有显著提升。本文利用现有IQA模型捕捉真实图像在带通统计空间中的流形特性,将其用于区分真实图像与AI生成图像。我们研究了此类感知分类器在生成图像检测任务中的泛化能力,并评估其对各类图像退化的鲁棒性。结果表明,在IQA模型特征空间上训练的两层网络,在跨生成模型检测中达到当前最优性能,且对图像降质具有显著鲁棒性。
原文摘要 · Abstract (English)
Image Quality Assessment (IQA) models are employed in many practical image and video processing pipelines to reduce storage, minimize transmission costs, and improve the Quality of Experience (QoE) of millions of viewers. These models are sensitive to a diverse range of image distortions and can accurately predict image quality as judged by human viewers. Recent advancements in generative models have resulted in a significant influx of "GenAI" content on the internet. Existing methods for detecting GenAI content have progressed significantly with improved generalization performance on images from unseen generative models. Here, we leverage the capabilities of existing IQA models, which effectively capture the manifold of real images within a bandpass statistical space, to distinguish between real and AI-generated images. We investigate the generalization ability of these perceptual classifiers to the task of GenAI image detection and evaluate their robustness against various image degradations. Our results show that a two-layer network trained on the feature space of IQA models demonstrates state-of-the-art performance in detecting fake images across generative models, while maintaining significant robustness against image degradations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。