构建10万张高真实感AI篡改图像数据集,提升检测挑战性
Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization

- 用闭环智能体自动生成多样化且逼真的篡改图像
- 包含7种AIGC模型、3类操作,每图多区域篡改
- 适合研究伪造检测与视觉语言模型鲁棒性的学者
生成式图像编辑技术的进展显著提升了局部篡改的逼真度与可控性,给图像篡改检测与定位(IMDL)带来新挑战。现有基准在视觉真实感、篡改多样性及生成器覆盖范围上仍存局限,难以反映当前趋势。为此,我们提出Impostor——一个包含10万张篡改图像的高质量数据集。Impostor由CraftAgent生成,该闭环智能体融合场景感知、编辑规划、执行、质量验证与迭代反思,可自动生成多样且逼真的篡改图像。数据集涵盖七种近期AIGC模型,三种篡改类型,每张图像含多个篡改区域,为基于AIGC的IMDL提供更全面评估基准。此外,我们提出PhaseAware-Net(PANet),一种引入局部相位建模与语义取证一致性学习的语义取证框架,能更好定位语义合理但取证信号异常的篡改区域。大量实验表明,Impostor对现有大型视觉语言模型(LVLMs)和专用IMDL方法构成严峻挑战,而PANet在Impostor及多个公开基准上均表现优异。
原文摘要 · Abstract (English)
Recent advances in generative image editing have improved the realism and controllability of localized image manipulation, raising new challenges for image manipulation detection and localization (IMDL). However, existing IMDL benchmarks still have limitations in visual realism, manipulation diversity, and generator coverage, making it difficult to reflect recent trends in image manipulation. To address these limitations, we introduce Impostor, a high-quality AI-edited image manipulation localization dataset containing 100K manipulated images. Impostor is constructed by CraftAgent, a closed-loop agent framework that integrates scene perception, editing planning, manipulation execution, quality validation, and iterative reflection to automatically generate diverse and visually realistic manipulated images. Moreover, Impostor contains images generated by seven recent AIGC models across three manipulation types and includes multiple manipulated regions, providing a more comprehensive benchmark for AIGC-based IMDL. Furthermore, we propose PhaseAware-Net (PANet), a semantic-forensic framework that introduces local phase modeling and semantic-forensic consistency learning to better localize semantically plausible yet forensically disrupted manipulated regions. Extensive experiments show that Impostor poses significant challenges to existing large vision-language models (LVLMs) and specialized IMDL methods, while PANet achieves superior performance on Impostor and multiple public benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。