arXiv:2605.30062cs.CV2026-05被引 2

让AI像人一样用物理常识识破假图,告别盲目模仿。

FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection

论文配图:FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection
图 1 · 摘自论文原文
  • 引入双向辩证推理机制,边猜造假边验证真实物理规律。
  • 在多个数据集上达到顶尖检测精度,且误拒真实图像率显著降低。
  • 专为提升可信度设计,适合需要可靠图像真实性判断的场景。

生成式AI使合成图像逼真度达到新高度。现有基于大模型的可解释检测方法仍依赖海量伪造数据的模仿学习,缺乏真正的因果推理能力,易产生解释性幻觉。为此,我们提出FakeVLM-R1,旨在赋予模型类人批判性思维能力。该框架在监督微调基础上,结合组相对策略优化(GRPO)与批判性思维链(CoT)机制。推理时,模型需同时提出伪造假设并借助物理常识构建真实性反证。此外,我们构建了高质量的FakeClue++数据集,引入基于真实图像物理规律的标注,为模型提供统一的真实性锚点。实验表明,FakeVLM-R1在多个基准测试中表现最优,不仅实现高精度、逻辑可解释的检测,还有效缓解了现有方法对真实图像的过度拒绝问题,展现出强泛化性与抗扰动鲁棒性。

原文摘要 · Abstract (English)

The development of generative artificial intelligence technologies has propelled the visual realism of synthetic images to an unprecedented level. Although current interpretable detection methods based on Large Multimodal Models (LMMs) have made certain progress, they still rely on imitation learning derived from massive volumes of forged data. Consequently, they lack genuine causal reasoning capabilities and are prone to explanatory hallucinations. To overcome this bottleneck, we propose FakeVLM-R1, aiming to endow the model with human-like critical thinking capabilities when performing synthetic detection tasks. Building upon Supervised Fine-Tuning (SFT), this framework integrates Group Relative Policy Optimization (GRPO) with a Critical Thinking Chain-of-Thought (CoT) mechanism. During the inference phase, the model executes a "bidirectional dialectical reasoning" process: while proposing a forgery hypothesis, it must simultaneously invoke physical commonsense to construct an authenticity counter-proof. Furthermore, we constructed the FakeClue++ dataset with high-quality samples, which extensively introduces annotations guided by the physical laws of authentic images, providing a unified authenticity anchor for the model. Experiments confirm that FakeVLM-R1 achieves SOTA performance the evaluated models across multiple benchmarks. It not only achieves high-precision, logically interpretable detection but also resolves the over-rejection bias of existing methods against real images, demonstrating generalization and robustness against perturbations.

图像检测物理常识批判思维伪造识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。