构建首个可验证的图像编辑溯源推理数据集,支持精准定位与解释。
EditSleuth: A Dataset of Grounded Reasoning Chains for Image-Edit Forensics

- 基于真实编辑三元组生成可追溯的六步推理链,每步有明确视觉证据支撑。
- 发现编辑难度受多因素影响,非仅由编辑类型决定,三成分评分更有效。
- 用推理链训练模型可生成可解释的说明文本,提升检测可信度。
AI编辑图像的取证分析不仅需要判断真假,还需定位修改区域、识别语义类型,并以视觉证据支撑决策。现有数据集多聚焦检测或定位,而视觉-语言推理数据集常依赖大模型生成的推理,其真实性难验证。我们提出EditSleuth,一个包含257,725个图像编辑三元组的数据集,源自已有编辑语料库。每个样本包含编辑后图像、源图像、二值编辑掩码、12类编辑类型标签、难度分数及六步推理链。推理链由三元组对应的上游可计算证据确定性生成,每一步均有对应视觉依据。分析显示,原始四组件难度评分存在等级特征相关性坍缩;简化为三组件后,在Pico-Banana和MagicBrush数据集上显著提升分数分散度。难度在多数编辑类别内仍具显著差异,表明其并非编辑类型的代理指标。初步实验中,使用LoRA微调Qwen2-VL-2B模型,以推理链为目标监督的方案在可解析答案上的分类准确率与仅标签监督相当,但额外生成了标签监督无法提供的可解释说明文本。数据集、构建流程与基础训练脚本均已开源。
原文摘要 · Abstract (English)
Forensic analysis of AI-edited images requires more than binary real-versus-fake prediction: a useful system should localize the edit, identify its semantic type, and ground its decisions in visual evidence. Existing image-forensics datasets typically emphasize detection or localization, while reasoning-supervised vision-language datasets rarely target image manipulation and often rely on LLM-generated rationales whose faithfulness is difficult to verify. We introduce EditSleuth, a dataset of 257,725 image-edit triplets constructed from existing image-editing corpora for grounded image-edit forensic reasoning. Each example includes an edited image, its source image, a binary edit mask, a 12-class edit taxonomy label, a difficulty score, and a six-step reasoning chain. EditSleuth chains are generated deterministically from triplet-grounded upstream artifacts, with each statement tied to a specific computable source of evidence. Our analysis reveals that a naive four-component difficulty formulation suffers from a rank-2 correlation collapse among magnitude features; a simplified three-component formulation substantially increases score dispersion on both Pico-Banana and MagicBrush. Difficulty also varies meaningfully within most edit categories, indicating that the score is not a proxy for edit type. As an initial learning study, we fine-tune Qwen2-VL-2B with LoRA and find that chain-as-target supervision matches a label-only baseline on classification accuracy among parseable answers, while additionally yielding grounded explanatory prose that label-only supervision cannot produce. We release the dataset, the deterministic construction pipeline, and pilot training scripts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。