arXiv:2603.01993cs.CV2026-03ACL被引 2

让模型像侦探一样推理,提升跨类型伪造检测能力

Cultivating Forensic Reasoning for Generalizable Multimodal Manipulation Detection

论文配图:Cultivating Forensic Reasoning for Generalizable Multimodal Manipulation Detection
图 1 · 摘自论文原文
  • 构建三阶段推理框架,从生成理由到修正逻辑
  • 在多个数据集上达到81.5%以上准确率,泛化能力显著提升
  • 适合需要可解释、抗新伪造的检测场景

生成式AI使多模态媒体伪造日益逼真,给检测带来挑战。现有方法多依赖结果监督进行伪造类型分类,缺乏可解释性且易过拟合表面痕迹。本文提出重构检测范式,主张引入显式取证推理以实现泛化检测。为此,我们提出REFORM框架,通过三阶段课程学习:先诱导取证理由,再对齐推理与判断,最后用强化学习优化逻辑一致性。为支持该方法,我们构建了大规模带丰富推理标注的数据集ROM。大量实验表明,REFORM在多个基准上表现优异,取得81.52%准确率(ROM)、76.65%准确率(DGM4)和74.9的F1值(MMFakeBench),达到新顶尖水平。

原文摘要 · Abstract (English)

Recent advances in generative AI have significantly enhanced the realism of multimodal media manipulation, thereby posing substantial challenges to manipulation detection. Existing manipulation detection and grounding approaches predominantly focus on manipulation type classification under result-oriented supervision, which not only lacks interpretability but also tends to overfit superficial artifacts. In this paper, we argue that generalizable detection requires incorporating explicit forensic reasoning, rather than merely classifying a limited set of manipulation types, which fails to generalize to unseen manipulation patterns. To this end, we propose REFORM, a reasoning-driven framework that shifts learning from outcome fitting to process modeling. REFORM adopts a three-stage curriculum that first induces forensic rationales, then aligns reasoning with final judgments, and finally refines logical consistency via reinforcement learning. To support this paradigm, we introduce ROM, a large-scale dataset with rich reasoning annotations. Extensive experiments show that REFORM establishes new state-of-the-art performance with superior generalization, achieving 81.52% ACC on ROM, 76.65% ACC on DGM4, and 74.9 F1 on MMFakeBench.

伪造检测推理机制多模态泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。