arXiv:2604.14570cs.CV2026-04被引 1

利用扩散模型噪声特征提升深伪检测泛化能力

Deepfake Detection Generalization with Diffusion Noise

论文配图:Deepfake Detection Generalization with Diffusion Noise
图 1 · 摘自论文原文
  • 通过扩散去噪过程提取图像噪声,引导检测器学习鲁棒特征
  • 在多个基准上显著优于现有方法,对未见伪造类型泛化性能提升明显
  • 无需额外推理开销,适合实际部署的深伪检测系统

深度伪造检测面临新图像生成技术带来的泛化挑战,尤其扩散模型生成的伪造图像高度逼真且常逃避基于GAN训练的检测器。本文提出注意力引导噪声学习(ANL)框架,将预训练扩散模型融入检测流程,利用其去噪过程揭示细微伪造痕迹:检测器被训练为预测输入图像在特定扩散步骤下的噪声,迫使模型捕捉真实与合成图像间的差异;同时引入基于预测噪声的注意力机制,引导模型关注全局分布的差异而非局部模式。借助冻结扩散模型对自然图像分布的学习,ANL起到正则化作用,显著提升检测器对未知伪造类型的泛化能力。大量实验表明,ANL在多个基准上显著超越现有方法,实现检测扩散生成伪造图像的最先进准确率。值得注意的是,该框架在推理阶段无额外开销,大幅提升了未见模型上的准确率(ACC/AP),验证了扩散噪声作为可泛化检测信号的有效性。

原文摘要 · Abstract (English)

Deepfake detectors face growing challenges in generalization as new image synthesis techniques emerge. In particular, deepfakes generated by diffusion models are highly photorealistic and often evade detectors trained on GAN-based forgeries. This paper addresses the generalization problem in deepfake detection by leveraging diffusion noise characteristics. We propose an Attention-guided Noise Learning (ANL) framework that integrates a pre-trained diffusion model into the deepfake detection pipeline to guide the learning of more robust features. Specifically, our method uses the diffusion model's denoising process to expose subtle artifacts: the detector is trained to predict the noise contained in an input image at a given diffusion step, forcing it to capture discrepancies between real and synthetic images, while an attention-guided mechanism derived from the predicted noise is introduced to encourage the model to focus on globally distributed discrepancies rather than local patterns. By harnessing the frozen diffusion model's learned distribution of natural images, the ANL method acts as a form of regularization, improving the detector's generalization to unseen forgery types. Extensive experiments demonstrate that ANL significantly outperforms existing methods on multiple benchmarks, achieving state-of-the-art accuracy in detecting diffusion-generated deepfakes. Notably, the proposed framework boosts generalization performance (e.g., improving ACC/AP by a substantial margin on unseen models) without introducing additional overhead during inference. Our results highlight that diffusion noise provides a powerful signal for generalizable deepfake detection.

深伪检测扩散模型泛化能力噪声学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。