用检索增强与强化学习,让AI自动识别假图并解释理由。
RAIDX: A Retrieval-Augmented Generation and GRPO Reinforcement Learning Framework for Explainable Deepfake Detection
- 结合外部知识库和强化学习,自动生成细粒度解释
- 在多个数据集上达到顶尖检测准确率,且可生成可解释结果
- 无需人工标注,适合需要透明决策的AI安全场景
人工智能生成模型的快速发展催生了高度逼真的虚假图像,带来广泛误导风险。现有深度伪造检测方法分为针对人脸的检测器或通用生成内容检测器,但均以分类任务为主,缺乏决策透明性。尽管已有基于大语言模型的方法提供解释,却存在分析粗略、依赖人工标注等问题。本文提出RAIDX(检索增强图像深度伪造检测与可解释性框架),融合检索增强生成(RAG)与组相对策略优化(GRPO),提升检测精度并实现自主生成细粒度文本解释与显著性图,无需大量人工标注。在多个基准测试中,RAIDX有效识别真实或伪造图像,同时提供文本描述与显著性图形式的可解释推理,达到当前最优检测性能,推动深度伪造识别的透明化。该框架是首个融合RAG与GRPO的统一系统,填补了准确性与可解释性双重短板。代码与模型将公开共享。
原文摘要 · Abstract (English)
The rapid advancement of AI-generation models has enabled the creation of hyperrealistic imagery, posing ethical risks through widespread misinformation. Current deepfake detection methods, categorized as face specific detectors or general AI-generated detectors, lack transparency by framing detection as a classification task without explaining decisions. While several LLM-based approaches offer explainability, they suffer from coarse-grained analyses and dependency on labor-intensive annotations. This paper introduces RAIDX (Retrieval-Augmented Image Deepfake Detection and Explainability), a novel deepfake detection framework integrating Retrieval-Augmented Generation (RAG) and Group Relative Policy Optimization (GRPO) to enhance detection accuracy and decision explainability. Specifically, RAIDX leverages RAG to incorporate external knowledge for improved detection accuracy and employs GRPO to autonomously generate fine-grained textual explanations and saliency maps, eliminating the need for extensive manual annotations. Experiments on multiple benchmarks demonstrate RAIDX's effectiveness in identifying real or fake, and providing interpretable rationales in both textual descriptions and saliency maps, achieving state-of-the-art detection performance while advancing transparency in deepfake identification. RAIDX represents the first unified framework to synergize RAG and GRPO, addressing critical gaps in accuracy and explainability. Our code and models will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。