通过信息论约束,提升图像伪造定位的全面性与准确性。
SUMI-IFL: An Information-Theoretic Framework for Image Forgery Localization with Sufficiency and Minimality Constraints
- 用互信息理论确保特征包含完整伪造线索
- 跨视角融合特征,提升线索覆盖度
- 抑制无关特征干扰,适合高精度伪造检测场景
图像伪造定位(IFL)是防止篡改图像滥用、保障社会安全的关键技术。然而,随着图像篡改技术快速发展,如何提取更全面、更准确的伪造线索仍面临挑战。为此,我们提出一种新的信息论框架SUMI-IFL,对伪造特征表示施加充分性与最小性约束。首先,基于互信息理论,在特征提取网络中引入充分性约束,确保潜在伪造特征包含完整的伪造线索;由于单一视角的线索可能不完整,我们通过融合多个视角的独立伪造特征构建潜在特征。其次,基于信息瓶颈原理,在特征推理网络中施加最小性约束,实现精准且紧凑的伪造特征表示,有效抑制无关特征干扰。大量实验表明,SUMI-IFL在同数据集和跨数据集对比中均优于现有最先进方法。
原文摘要 · Abstract (English)
Image forgery localization (IFL) is a crucial technique for preventing tampered image misuse and protecting social safety. However, due to the rapid development of image tampering technologies, extracting more comprehensive and accurate forgery clues remains an urgent challenge. To address these challenges, we introduce a novel information-theoretic IFL framework named SUMI-IFL that imposes sufficiency-view and minimality-view constraints on forgery feature representation. First, grounded in the theoretical analysis of mutual information, the sufficiency-view constraint is enforced on the feature extraction network to ensure that the latent forgery feature contains comprehensive forgery clues. Considering that forgery clues obtained from a single aspect alone may be incomplete, we construct the latent forgery feature by integrating several individual forgery features from multiple perspectives. Second, based on the information bottleneck, the minimality-view constraint is imposed on the feature reasoning network to achieve an accurate and concise forgery feature representation that counters the interference of task-unrelated features. Extensive experiments show the superior performance of SUMI-IFL to existing state-of-the-art methods, not only on in-dataset comparisons but also on cross-dataset comparisons.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。