首个可解释AIGC检测框架与基准,支持图像视频多模态检测。
Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection
- 构建多维度标注数据集,支持细粒度可解释检测。
- 在GenImage上检测准确率从86.88%提升至96.32%。
- 适合需要可信检测与推理过程的研究者使用。
人工智能生成内容(AIGC)技术迅猛发展,虽能生成高质量合成内容,却带来严重安全风险。现有检测方法面临两大挑战:一是缺乏多维度可解释的数据集,现有开源数据集(如WildFake、GenVideo)依赖简化二分类标注,限制了检测器的可解释性与可信度;二是基于多模态大模型的伪造检测器(如FakeVLM)在分步推理中解释粒度不足,难以实现可靠定位与解释。为此,我们提出Ivy-Fake,首个大规模多模态可解释AIGC检测基准。该数据集包含超过106,000条丰富标注的训练样本(图像与视频)及5,000条人工验证的评估样例,源自多个生成模型与真实世界数据集,通过精心设计的流水线确保多样性和质量。此外,我们提出Ivy-xDetector,一种基于组相对策略优化(GRPO)的强化学习模型,能够生成可解释的推理链,在多个合成内容检测基准上表现稳健。大量实验验证了数据集与方法的优越性,尤其在GenImage上,准确率由86.88%提升至96.32%,显著超越现有最先进方法。
原文摘要 · Abstract (English)
The rapid development of Artificial Intelligence Generated Content (AIGC) techniques has enabled the creation of high-quality synthetic content, but it also raises significant security concerns. Current detection methods face two major limitations: (1) the lack of multidimensional explainable datasets for generated images and videos. Existing open-source datasets (e.g., WildFake, GenVideo) rely on oversimplified binary annotations, which restrict the explainability and trustworthiness of trained detectors. (2) Prior MLLM-based forgery detectors (e.g., FakeVLM) exhibit insufficiently fine-grained interpretability in their step-by-step reasoning, which hinders reliable localization and explanation. To address these challenges, we introduce Ivy-Fake, the first large-scale multimodal benchmark for explainable AIGC detection. It consists of over 106K richly annotated training samples (images and videos) and 5,000 manually verified evaluation examples, sourced from multiple generative models and real world datasets through a carefully designed pipeline to ensure both diversity and quality. Furthermore, we propose Ivy-xDetector, a reinforcement learning model based on Group Relative Policy Optimization (GRPO), capable of producing explainable reasoning chains and achieving robust performance across multiple synthetic content detection benchmarks. Extensive experiments demonstrate the superiority of our dataset and confirm the effectiveness of our approach. Notably, our method improves performance on GenImage from 86.88% to 96.32%, surpassing prior state-of-the-art methods by a clear margin.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。