arXiv:2602.14098cs.CV2026-02被引 2

用视觉推理替代文字描述,精准定位图像篡改痕迹。

ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization

  • 引入取证工具生成可见的视觉中间结果,实现视觉中心推理。
  • 在多个数据集上达到当前最佳检测与定位性能,且工具使用冗余低。
  • 适合关注图像伪造检测、多模态模型可解释性的研究者使用。

现有用于图像伪造检测与定位的多模态大模型大多采用以文本为中心的思维链(CoT)范式。但强制模型用语言描述难以察觉的低级篡改痕迹,极易引发幻觉,因语言模态无法捕捉细微的像素级不一致。为此,我们提出 ForgeryVCR 框架,通过融入取证工具箱,将不可见的篡改痕迹转化为显式的视觉中间表示,实现视觉中心推理。为提升工具使用效率,提出一种策略性工具学习后训练范式,包含基于收益驱动的轨迹构建用于监督微调(SFT),以及由工具效用奖励引导的强化学习(RL)优化。该范式使大模型能主动决策,自发调用多视角推理路径,包括局部放大进行细粒度检查,以及分析压缩历史、噪声残差和频域中的隐性不一致。大量实验表明,ForgeryVCR 在检测与定位任务中均取得当前最优表现,展现出卓越的泛化能力与鲁棒性,且工具冗余极少。代码已开源:https://github.com/youqiwong/ForgeryVCR。

原文摘要 · Abstract (English)

Existing Multimodal Large Language Models (MLLMs) for image forgery detection and localization predominantly operate under a text-centric Chain-of-Thought (CoT) paradigm. However, forcing these models to textually characterize imperceptible low-level tampering traces inevitably leads to hallucinations, as linguistic modalities are insufficient to capture such fine-grained pixel-level inconsistencies. To overcome this, we propose ForgeryVCR, a framework that incorporates a forensic toolbox to materialize imperceptible traces into explicit visual intermediates via Visual-Centric Reasoning. To enable efficient tool utilization, we introduce a Strategic Tool Learning post-training paradigm, encompassing gain-driven trajectory construction for Supervised Fine-Tuning (SFT) and subsequent Reinforcement Learning (RL) optimization guided by a tool utility reward. This paradigm empowers the MLLM to act as a proactive decision-maker, learning to spontaneously invoke multi-view reasoning paths including local zoom-in for fine-grained inspection and the analysis of invisible inconsistencies in compression history, noise residuals, and frequency domains. Extensive experiments reveal that ForgeryVCR achieves state-of-the-art (SOTA) performance in both detection and localization tasks, demonstrating superior generalization and robustness with minimal tool redundancy. The code is available at https://github.com/youqiwong/ForgeryVCR.

图像伪造多模态视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。