arXiv:2508.07413cs.CV2025-08被引 1

用AI生成模型的隐含机制定位图像伪造,精度超现有方法

CLUE: Leveraging Low-Rank Adaptation to Capture Latent Uncovered Evidence for Image Forgery Localization

  • 借力Stable Diffusion的生成过程,通过低秩适配放大伪造痕迹
  • 在多个数据集上超越已有方法,对常见后处理攻击仍具鲁棒性
  • 适合做图像真实性检测的研究者和安全防护开发者

图像编辑工具与生成式AI的普及导致大量视觉逼真的伪造图像泛滥,威胁数字媒体的真实性。本文不仅利用传统伪造带来的失真,还重新利用先进文本到图像生成模型的内部生成机制,将其转化为高保真伪造定位工具。为此,提出CLUE(Capture Latent Uncovered Evidence)框架,采用低秩适配(LoRA)高效重配置Stable Diffusion 3(SD3)作为取证特征提取器。方法首先利用SD3的修正流(RF)机制,在潜在表示中注入不同强度噪声,引导经LoRA调优的去噪过程放大伪造导致的细微统计不一致。为补充潜在分析中的高层语义与精确空间细节,引入了参数高效适配的Segment Anything Model(SAM)图像编码器上下文特征,以更好追踪伪造区域边界。大量实验表明,CLUE在泛化性能上达到当前最优水平,显著优于先前方法,且对常见后处理攻击和在线社交网络(OSNs)具有更强鲁棒性。代码已公开于https://github.com/SZAISEC/CLUE。

原文摘要 · Abstract (English)

The increasing accessibility of image editing tools and generative AI has led to a proliferation of visually convincing forgeries, compromising the authenticity of digital media. In this paper, in addition to leveraging distortions from conventional forgeries, we repurpose the mechanism of a state-of-the-art (SOTA) text-to-image synthesis model by exploiting its internal generative process, turning it into a high-fidelity forgery localization tool. To this end, we propose CLUE (Capture Latent Uncovered Evidence), a framework that employs Low- Rank Adaptation (LoRA) to parameter-efficiently reconfigure Stable Diffusion 3 (SD3) as a forensic feature extractor. Our approach begins with the strategic use of SD3's Rectified Flow (RF) mechanism to inject noise at varying intensities into the latent representation, thereby steering the LoRAtuned denoising process to amplify subtle statistical inconsistencies indicative of a forgery. To complement the latent analysis with high-level semantic context and precise spatial details, our method incorporates contextual features from the image encoder of the Segment Anything Model (SAM), which is parameter-efficiently adapted to better trace the boundaries of forged regions. Extensive evaluations demonstrate CLUE's SOTA generalization performance, significantly outperforming prior methods. Furthermore, CLUE shows superior robustness against common post-processing attacks and Online Social Networks (OSNs). Code is publicly available at https://github.com/SZAISEC/CLUE.

图像伪造生成模型取证检测低秩适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。