arXiv:2505.18660cs.CV2025-05

构建百万级伪造图像数据集,提升社交平台假图检测能力。

So-Fake: Benchmarking and Explaining Social Media Image Forgery Detection

  • 构建含200万张图像的So-Fake-Set数据集,覆盖35种生成模型。
  • 提出10万张跨域测试集,验证模型对未知生成技术的泛化能力。
  • 开发So-Fake-R1框架,实现高精度检测与可解释性定位,适合安全与内容审核研究者。

AI生成模型的发展使合成图像愈发逼真,严重威胁社交媒体的信息真实性和公众信任。现有学术研究在数据多样性和检测泛化能力方面存在不足:当前数据集缺乏社会媒体场景所需的多样性、规模和真实性,而检测方法难以适应未见过的生成技术。为此,我们提出So-Fake-Set,一个面向社交媒体的综合性数据集,包含超过200万张高质量图像,涵盖35种顶尖生成模型,具有高度写实性。为严格评估跨域鲁棒性,我们建立了一个大规模(10万张)的域外基准(So-Fake-OOD),其合成图像来自训练分布之外的商用模型,模拟真实世界挑战。基于这些资源,我们提出So-Fake-R1,一种基于强化学习的视觉语言框架,实现高精度伪造检测、精准定位以及可解释推理。大量实验表明,So-Fake-R1优于次优方法,在检测准确率上提升1.3%,定位交并比(IoU)提高4.5%。该工作通过可扩展数据集、严苛的域外基准与先进检测框架,为社交媒体伪造检测研究奠定了新基础。代码、模型与数据集将公开发布。

原文摘要 · Abstract (English)

Recent advances in AI-powered generative models have enabled the creation of increasingly realistic synthetic images, posing significant risks to information integrity and public trust on social media platforms. While robust detection frameworks and diverse, large-scale datasets are essential to mitigate these risks, existing academic efforts remain limited in scope: current datasets lack the diversity, scale, and realism required for social media contexts, while detection methods struggle with generalization to unseen generative technologies. To bridge this gap, we introduce So-Fake-Set, a comprehensive social media-oriented dataset with over 2 million high-quality images, diverse generative sources, and photorealistic imagery synthesized using 35 state-of-the-art generative models. To rigorously evaluate cross-domain robustness, we establish a novel and large-scale (100K) out-of-domain benchmark (So-Fake-OOD) featuring synthetic imagery from commercial models explicitly excluded from the training distribution, creating a realistic testbed for evaluating real-world performance. Leveraging these resources, we present So-Fake-R1, an advanced vision-language framework that employs reinforcement learning for highly accurate forgery detection, precise localization, and explainable inference through interpretable visual rationales. Extensive experiments show that So-Fake-R1 outperforms the second-best method, with a 1.3% gain in detection accuracy and a 4.5% increase in localization IoU. By integrating a scalable dataset, a challenging OOD benchmark, and an advanced detection framework, this work establishes a new foundation for social media-centric forgery detection research. The code, models, and datasets will be released publicly.

图像伪造检测基准视觉语言可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。