arXiv:2609.02097cs.CV2026-09

提出证据引导的图文伪造检测系统,实现精准定位与可解释报告。

Evidence-Guided Detection, Localization and Explanation for Text-Centric Image Forensics

论文配图:Evidence-Guided Detection, Localization and Explanation for Text-Centric Image Forensics
图 1 · 摘自论文原文
  • 分三步:全局检测→局部定位→基于多模态大模型的推理报告
  • 在隐藏测试集上得分0.638,排名第二,定位准确率高
  • 适合需要可解释性伪造分析的AI安全与内容审核场景

AIGC的快速发展使文本驱动的图像篡改愈发普遍,带来了不仅需判断真伪,还需精确定位篡改区域并提供证据支持的解释。本文针对ACM Multimedia 2026的GenText-Forensics挑战,提出一种证据引导的检测-定位-推理系统:图像级检测器提供全局真实性先验,专用定位器提取篡改区域作为空间证据,基于多模态大模型(MLLM)的推理器据此生成结构化报告。三模块通过级联证据流连接:检测器控制后续流程,定位器将篡改响应转为边界框,推理器学习融合检测结果与局部证据生成最终报告。关键创新包括迭代难度感知挖掘以提升定位质量,以及报告掩码一致性后处理,确保报告描述与预测掩码对齐。在官方隐藏测试集上,系统取得0.638的最终得分,排名第二,验证了该方法的有效性。代码已开源。

原文摘要 · Abstract (English)

The rapid progress of AIGC has made text-centric image manipulation increasingly accessible, creating new forensic challenges that require not only authenticity detection but also spatial grounding and evidence-based explanation. This paper presents our solution to the GenText-Forensics Challenge at ACM Multimedia 2026. We propose an evidence-guided detector-localizer-reasoner system, where an image-level detector provides a global authenticity prior, a dedicated localizer extracts tampered regions as spatial grounding evidence, and an MLLM-based reasoner generates structured forensic reports grounded in this expert forensic evidence. These modules are connected through a cascaded evidence flow: the detector gates the subsequent localization and prompting process, the localizer converts tamper responses into grounding boxes, and the reasoner is trained to synthesize the detector decision and localized evidence into the final report. As a key part of our method, we introduce iterative difficulty-aware mining to improve localization quality and apply report-mask consistency post-processing to align report grounding with predicted masks. On the official hidden test set, our system achieves a final score of 0.638 and ranks second in the challenge, validating the effectiveness of the proposed evidence-guided system. The code is available at https://github.com/peifengLiu42/ACMMM26-evidence-guided-detector-localizer-reasoner-system.

图像取证可解释性多模态大模型伪造检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。