用可靠3D几何信息弥补2D伪造痕迹不足,提升图像篡改定位精度
When 2D Cues Fail: Improving Image Manipulation Localization with Reliable 3D Geometry

- 通过单目重建获取深度与法向量,评估其可靠性后选择性使用
- 在有限算力下实现更精细的篡改区域定位,优于纯2D方法
- 适合需要高精度伪造检测的场景,如数字取证与内容安全
现有图像篡改定位(IML)方法主要依赖2D取证线索,如低级伪影、噪声痕迹和语义不一致。当篡改区域与周围环境外观融合良好时,这些线索变得不敏感。此时,篡改区域虽视觉一致,但违反了场景几何结构。为此,本文提出引入几何推理:利用单目重建获得深度与表面法向量作为辅助线索。由于重建结果本身噪声大,不能直接使用,因此我们先评估其可靠性,再选择性地融合进模型。基于此,设计了几何感知框架GFrame,将可靠的几何线索与RGB特征跨尺度融合,提升细粒度定位能力。大量实验表明,该方法在资源受限条件下表现优异,证明了可靠3D几何可为IML提供超越传统2D线索的补充证据。
原文摘要 · Abstract (English)
Existing image manipulation localization (IML) methods rely heavily on 2D forensic cues, such as low-level artifacts, noise traces, and semantic inconsistencies in the manipulated image. While effective in many cases, these cues become much less discriminative when manipulated regions are well blended with their surrounding context in appearance. In such cases, a manipulated region may remain locally appearance-consistent, but still violate the geometric structure of the surrounding scene. This limitation motivates us to go beyond purely 2D evidence and introduce geometric reasoning into IML. To this end, we leverage monocular reconstruction to obtain auxiliary geometric cues, including depth and surface normals. However, a key challenge lies in the fact that reconstructed geometry on manipulated images is inherently noisy and cannot be used naively. Rather than treating depth and normals as direct evidence, we estimate their reliability and exploit them selectively for localization. Based on this principle, we design a geometry-aware framework (GFrame) that fuses reliable geometric cues with RGB features and propagates them across scales to improve fine-grained localization. Extensive experiments show that the proposed method achieves excellent performance under limited budget constraints. These results indicate that reliable 3D geometry provides complementary forensic evidence beyond traditional 2D cues for IML. Related code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。