arXiv:2508.03967cs.CVcs.CR2025-08被引 1

用视觉检索增强识别AI生成图像,准确率达93.85%。

RAVID: Retrieval-Augmented Visual Detection: A Knowledge-Driven Approach for AI-Generated Image Identification

  • 通过检索相关图像增强输入,提升检测表示能力
  • 在19种生成模型上平均准确率93.85%,降噪下仍达80.27%
  • 适合需要高鲁棒性的图像真实性检测场景

本文提出RAVID,首个利用视觉检索增强生成(RAG)的AI生成图像检测框架。尽管RAG在缓解大模型事实错误方面表现良好,但主要集中于文本,视觉知识利用不足。现有检测方法依赖低层伪影和模型特异性特征,泛化性差。RAVID通过动态检索相关图像增强检测。采用微调的CLIP图像编码器RAVID CLIP,结合类别提示提升表征学习,并集成视觉语言模型(VLM)融合检索图像与查询图像,丰富输入。给定查询图像后,使用RAVID CLIP生成嵌入,从数据库中检索最相关图像,并与查询图像组合后输入VLM(如Qwen-VL或Openflamingo)。在包含19种生成模型的UniversalFakeDetect基准测试中,RAVID达到93.85%平均准确率,优于传统方法。在图像退化条件下(如高斯模糊、JPEG压缩),其平均准确率为80.27%,显著高于C2P-CLIP的63.44%,展现出更强鲁棒性。代码将在录用后公开。

原文摘要 · Abstract (English)

In this paper, we introduce RAVID, the first framework for AI-generated image detection that leverages visual retrieval-augmented generation (RAG). While RAG methods have shown promise in mitigating factual inaccuracies in foundation models, they have primarily focused on text, leaving visual knowledge underexplored. Meanwhile, existing detection methods, which struggle with generalization and robustness, often rely on low-level artifacts and model-specific features, limiting their adaptability. To address this, RAVID dynamically retrieves relevant images to enhance detection. Our approach utilizes a fine-tuned CLIP image encoder, RAVID CLIP, enhanced with category-related prompts to improve representation learning. We further integrate a vision-language model (VLM) to fuse retrieved images with the query, enriching the input and improving accuracy. Given a query image, RAVID generates an embedding using RAVID CLIP, retrieves the most relevant images from a database, and combines these with the query image to form an enriched input for a VLM (e.g., Qwen-VL or Openflamingo). Experiments on the UniversalFakeDetect benchmark, which covers 19 generative models, show that RAVID achieves state-of-the-art performance with an average accuracy of 93.85%. RAVID also outperforms traditional methods in terms of robustness, maintaining high accuracy even under image degradations such as Gaussian blur and JPEG compression. Specifically, RAVID achieves an average accuracy of 80.27% under degradation conditions, compared to 63.44% for the state-of-the-art model C2P-CLIP, demonstrating consistent improvements in both Gaussian blur and JPEG compression scenarios. The code will be publicly available upon acceptance.

图像检测视觉检索AI生成鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。