通过融合多尺度特征与边缘监督,提升图像拼接定位精度。
Multi-Scale Cross-Fusion and Edge-Supervision Network for Image Splicing Localization
- 多尺度特征跨域融合增强表示能力
- 边缘掩码预测有效挖掘边界伪影
- 注意力机制融合边缘信息,减少误报
图像拼接定位(ISL)是数字取证中的基础且挑战性任务。尽管现有方法已取得良好效果,但边缘信息利用不足,导致定位完整性差、误报率高。为此,本文提出一种多尺度交叉融合与边缘监督网络。首先,将原始图像与噪声图像输入分割网络,学习多尺度特征,并通过跨尺度与跨域融合增强表征;其次,设计边缘掩码预测模块,有效挖掘可靠边界伪影;最后,利用注意力机制将融合特征与边缘掩码信息无缝整合,实现渐进式监督与模型优化。在多个公开数据集上的实验表明,该方法优于当前最先进方案。
原文摘要 · Abstract (English)
Image Splicing Localization (ISL) is a fundamental yet challenging task in digital forensics. Although current approaches have achieved promising performance, the edge information is insufficiently exploited, resulting in poor integrality and high false alarms. To tackle this problem, we propose a multi-scale cross-fusion and edge-supervision network for ISL. Specifically, our framework consists of three key steps: multi-scale features cross-fusion, edge mask prediction and edge-supervision localization. Firstly, we input the RGB image and its noise image into a segmentation network to learn multi-scale features, which are then aggregated via a cross-scale fusion followed by a cross-domain fusion to enhance feature representation. Secondly, we design an edge mask prediction module to effectively mine the reliable boundary artifacts. Finally, the cross-fused features and the reliable edge mask information are seamlessly integrated via an attention mechanism to incrementally supervise and facilitate model training. Extensive experiments on publicly available datasets demonstrate that our proposed method is superior to state-of-the-art schemes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。