利用颜色统计差异,93%准确率识别AI生成图像。
Chroma Clues: Leveraging Color Statistics to Detect Synthetic Images

- 基于颜色变换检测生成图像的统计偏差。
- 在六类后处理下仍保持93.27%平均准确率。
- 适合需要可解释性与视觉评估的检测场景。
AI生成图像的快速发展对图像取证构成挑战。本文发现,当前图像生成模型训练中使用的LPIPS损失对色度敏感度低于亮度,导致合成图像在颜色统计上存在偏差。基于此,我们提出六种手工设计的颜色变换及一种任务优化的色彩变换方法,用于揭示生成图像的统计特征。这些变换可用于像素级或块级颜色敏感特征提取,结合简单分类器,在六种后处理攻击下实现93.27%的平均泛化准确率,且结果具有高度可解释性。此外,变换后的图像显现出自然与合成区域特有的视觉噪声模式,支持直观评估。最后,该方法还能增强生成图像中的颜色模式,提升多类别归属识别能力。
原文摘要 · Abstract (English)
The evolution and dissemination of AI-synthesized images is occurring at an unprecedented rate. Image generators are making rapid progress in their goal of perfectly imitating natural images, which also challenges image forensics. In this work, we exploit an underexplored cue in current generative models, namely their weakness to imitate color statistics of natural images. We first show that the LPIPS loss used for training image generators is less sensitive to chrominance than to luminance, which may lead to statistical discrepancies in the colors of synthetic images. Building on this observation, we then introduce six hand-crafted color transformations and a method to learn a task-optimized color transform to statistically expose generated images. These transformations can be used in various ways. First, we define color-sensitive features at pixel-level or patch-level. A simple, interpretable classifier achieves with these features an average generalization accuracy of 93.27% and strong robustness against six types of post-processing. Second, we demonstrate that the transformations exhibit characteristic visual noise patterns in natural and synthetic image areas, which enables an intuitive visual image evaluation. Third, we demonstrate that the transforms can enhance color patterns in generated images for improved multiclass attribution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。