首个统一假图检测与定位基准,打破四个领域间的数据与模型壁垒。
ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localization

- 模块化架构支持跨领域组件灵活组合,实现多场景无缝对接。
- 集成10个基线模型、6种主干网络及2个新基准,覆盖全部四类假图任务。
- 提供8项关键洞察,助力模型设计与评估标准优化,适合研究者与开发者使用。
假图检测与定位(FIDL)领域高度碎片化,涵盖四大方向:深度伪造检测(Deepfake)、图像篡改检测与定位(IMDL)、AI生成图像检测(AIGC)和文档图像篡改定位(Doc)。尽管部分领域已有独立基准,但全领域统一基准仍属空白。缺乏统一基准导致各领域形成数据与模型孤岛,难以互通,阻碍跨域比较与整体发展。为此,我们提出ForensicHub——首个面向全领域的假图检测与定位统一基准与代码库。针对各领域在数据集、模型和评估配置上的巨大差异,以及部分领域开源基线模型稀缺的问题,ForensicHub具备:i)模块化、可配置的架构,将检测流程分解为可互换的组件,支持跨数据集、变换、模型和评估器的灵活组合;ii)完整实现10个基线模型、6种主干网络,构建2个新基准(AIGC和Doc),并通过适配器设计整合已有的DeepfakeBench和IMDLBenCo;iii)基于ForensicHub开展深入分析,得出8项可操作的关键洞察,涵盖模型架构、数据特征与评估标准。ForensicHub显著推动了打破FIDL领域孤岛,为未来突破奠定基础。
原文摘要 · Abstract (English)
The field of Fake Image Detection and Localization (FIDL) is highly fragmented, encompassing four domains: deepfake detection (Deepfake), image manipulation detection and localization (IMDL), artificial intelligence-generated image detection (AIGC), and document image manipulation localization (Doc). Although individual benchmarks exist in some domains, a unified benchmark for all domains in FIDL remains blank. The absence of a unified benchmark results in significant domain silos, where each domain independently constructs its datasets, models, and evaluation protocols without interoperability, preventing cross-domain comparisons and hindering the development of the entire FIDL field. To close the domain silo barrier, we propose ForensicHub, the first unified benchmark & codebase for all-domain fake image detection and localization. Considering drastic variations on dataset, model, and evaluation configurations across all domains, as well as the scarcity of open-sourced baseline models and the lack of individual benchmarks in some domains, ForensicHub: i) proposes a modular and configuration-driven architecture that decomposes forensic pipelines into interchangeable components across datasets, transforms, models, and evaluators, allowing flexible composition across all domains; ii) fully implements 10 baseline models, 6 backbones, 2 new benchmarks for AIGC and Doc, and integrates 2 existing benchmarks of DeepfakeBench and IMDLBenCo through an adapter-based design; iii) conducts indepth analysis based on the ForensicHub, offering 8 key actionable insights into FIDL model architecture, dataset characteristics, and evaluation standards. ForensicHub represents a significant leap forward in breaking the domain silos in the FIDL field and inspiring future breakthroughs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。