arXiv:2509.20006cs.CV2025-09被引 3

提出分步预测图像篡改位置的新方法,更贴近真实复杂的编辑过程。

Revisiting Image Manipulation Localization under Realistic Manipulation Scenarios

  • 将篡改定位重构为按步骤预测的序列任务,显式建模编辑顺序与层级结构
  • 在传统基准上实现最佳泛化能力,且计算效率不降
  • 适合研究篡改检测中多步操作建模的学者与开发者

随着大模型降低篡改操作的门槛,当前真实场景下的图像篡改常涉及一系列复杂编辑步骤以制造欺骗性图像。然而,现有图像篡改定位(IML)方法仍采用一击即成的预测范式,忽略编辑过程中的内在步骤,将高维组合空间压缩为单一二值掩码,导致维度坍缩,丢失关键结构线索,引发过拟合和泛化能力下降。为此,我们首次将图像篡改定位重新定义为条件序列预测任务,提出RITA框架:逐层有序预测篡改区域,并利用前一步预测结果作为下一步条件,显式建模编辑操作间的时序依赖与层级关系。为支持训练与评估,我们合成多步篡改数据并构建新基准HSIM,提出HSS指标衡量序列顺序与层级对齐。大量实验表明:1)RITA在传统基准上达到最优泛化与鲁棒性;2)尽管显式建模多步序列,仍保持高效计算;3)为层次化、过程感知的篡改定位奠定可行基础。代码与数据集已开源。

原文摘要 · Abstract (English)

With the large models easing the labor-intensive manipulation process, image manipulations in today's real scenarios often entail a complex manipulation process, comprising a series of editing operations to create a deceptive image. However, existing IML methods remain manipulation-process-agnostic, directly producing localization masks in a one-shot prediction paradigm without modeling the underlying editing steps. This one-shot paradigm compresses the high-dimensional compositional space into a single binary mask, inducing severe dimensional collapse, which forces the model to discard essential structural cues and ultimately leads to overfitting and degraded generalization. To address this, we are the first to reformulate image manipulation localization as a conditional sequence prediction task, proposing the RITA framework. RITA predicts manipulated regions layer-by-layer in an ordered manner, using each step's prediction as the condition for the next, thereby explicitly modeling temporal dependencies and hierarchical structures among editing operations. To enable training and evaluation, we synthesize multi-step manipulation data and construct a new benchmark HSIM. We further propose the HSS metric to assess sequential order and hierarchical alignment. Extensive experiments show that: 1) RITA achieves SOTA generalization and robustness on traditional benchmarks; 2) it remains computationally efficient despite explicitly modeling multi-step sequences; and 3) it establishes a viable foundation for hierarchical, process-aware manipulation localization. Code and dataset are available at https://github.com/scu-zjz/RITA.

篡改定位序列预测多步编辑图像安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。