用不规则内容区域建图,提升图像篡改检测精度
HRGR: Enhancing Image Manipulation Detection via Hierarchical Region-aware Graph Reasoning
- 基于内容一致性的不规则区域生成图节点
- 分层区域图结合结构无关推理,增强特征表达
- 可无缝嵌入主流网络,无需额外标注
图像篡改检测旨在识别图像中每个像素的真实性。现有方法通常以固定大小的网格作为图节点来建模图像相关性,但这些网格与图像内容无关,难以保持局部内容连贯性,导致检测精度不足。为此,本文提出层次化区域感知图推理(HRGR)方法,不再使用固定网格,而是通过一种新型可微分特征划分策略生成具有内容一致性的不规则区域,并在不同特征层级间构建层次化区域感知图。随后设计了一种结构无关的图推理策略,以增强节点表征能力。该方法全程可微,能以端到端方式无缝集成至主流网络,无需额外监督。大量实验表明,该方法在图像篡改检测任务中表现优异,具备作为即插即用组件的潜力。代码与模型已开源于 https://github.com/OUC-VAS/HRGR-IMD。
原文摘要 · Abstract (English)
Image manipulation detection is to identify the authenticity of each pixel in images. One typical approach to uncover manipulation traces is to model image correlations. The previous methods commonly adopt the grids, which are fixed-size squares, as graph nodes to model correlations. However, these grids, being independent of image content, struggle to retain local content coherence, resulting in imprecise detection.To address this issue, we describe a new method named Hierarchical Region-aware Graph Reasoning (HRGR) to enhance image manipulation detection. Unlike existing grid-based methods, we model image correlations based on content-coherence feature regions with irregular shapes, generated by a novel Differentiable Feature Partition strategy. Then we construct a Hierarchical Region-aware Graph based on these regions within and across different feature layers. Subsequently, we describe a structural-agnostic graph reasoning strategy tailored for our graph to enhance the representation of nodes. Our method is fully differentiable and can seamlessly integrate into mainstream networks in an end-to-end manner, without requiring additional supervision. Extensive experiments demonstrate the effectiveness of our method in image manipulation detection, exhibiting its great potential as a plug-and-play component for existing architectures. Codes and models are available at https://github.com/OUC-VAS/HRGR-IMD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。