arXiv:2511.14259cs.CV2025-11被引 4

提出统一框架ManipShield,实现图像篡改检测、定位与解释。

ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation

  • 基于多模态大模型,结合对比微调与专用解码器。
  • 在45万张图像上验证,对未见模型泛化能力强。
  • 支持可解释性,适合安全审查与内容溯源场景。

随着生成模型的快速发展,新型图像编辑技术已能实现高度逼真的篡改效果,远超传统深度伪造手段,给检测带来新挑战。现有图像篡改检测与定位(IMDL)基准存在内容多样性不足、生成模型覆盖有限、可解释性差等问题,制约了检测方法的泛化与可解释能力。为此,我们提出大规模基准ManipBench,包含25种先进图像编辑模型生成的45万余张篡改图像,涵盖12类操作,其中10万张配有边界框、判断线索和文本解释,支持可解释检测。基于ManipBench,我们构建ManipShield——一个基于多模态大语言模型(MLLM)的统一模型,采用对比LoRA微调和任务专用解码器,实现检测、定位与解释一体化。在ManipBench及多个公开数据集上的实验证明,ManipShield性能达到当前最优,并展现出对未见篡改模型的强大泛化能力。两者将在论文发表后公开。

原文摘要 · Abstract (English)

With the rapid advancement of generative models, powerful image editing methods now enable diverse and highly realistic image manipulations that far surpass traditional deepfake techniques, posing new challenges for manipulation detection. Existing image manipulation detection and localization (IMDL) benchmarks suffer from limited content diversity, narrow generative-model coverage, and insufficient interpretability, which hinders the generalization and explanation capabilities of current manipulation detection methods. To address these limitations, we introduce \textbf{ManipBench}, a large-scale benchmark for image manipulation detection and localization focusing on AI-edited images. ManipBench contains over 450K manipulated images produced by 25 state-of-the-art image editing models across 12 manipulation categories, among which 100K images are further annotated with bounding boxes, judgment cues, and textual explanations to support interpretable detection. Building upon ManipBench, we propose \textbf{ManipShield}, an all-in-one model based on a Multimodal Large Language Model (MLLM) that leverages contrastive LoRA fine-tuning and task-specific decoders to achieve unified image manipulation detection, localization, and explanation. Extensive experiments on ManipBench and several public datasets demonstrate that ManipShield achieves state-of-the-art performance and exhibits strong generality to unseen manipulation models. Both ManipBench and ManipShield will be released upon publication.

图像篡改多模态可解释性检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。