arXiv:2602.06452cs.CV2026-02

利用镜面反射不一致性检测扩散模型生成的伪造人脸

Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection

  • 基于Retinex理论快速分离镜面反射成分
  • 在扩散模型伪造数据集上准确率提升12.3%
  • 适合研究伪造检测与生成模型对抗的学者

随着扩散模型等AI生成方法合成的人脸质量与分辨率不断提升,深度伪造检测面临严峻挑战。现有依赖空间与频域特征的方法对高质量完全合成伪造人脸效果有限。本文提出一种新方法,基于面部属性受复杂物理规律约束、难以复现的观察,聚焦于Phong光照模型中的镜面反射成分——因其参数复杂且非线性,最难复制。我们提出基于Retinex理论的快速人脸纹理估计方法,实现精确的镜面反射分离。进一步地,根据镜面反射的数学表达,认为伪造痕迹不仅体现在镜面反射本身,还体现在其与对应人脸纹理及直接光照的关系中。为此,设计了两阶段交叉注意力机制的SRI-Net,融合镜面反射相关特征与图像特征,实现鲁棒检测。实验表明,该方法在传统深度伪造数据集及生成型伪造数据集上均表现优异,尤其在扩散模型生成的伪造人脸检测中显著优于现有方法。

原文摘要 · Abstract (English)

Detecting deepfakes has become increasingly challenging as forgery faces synthesized by AI-generated methods, particularly diffusion models, achieve unprecedented quality and resolution. Existing forgery detection approaches relying on spatial and frequency features demonstrate limited efficacy against high-quality, entirely synthesized forgeries. In this paper, we propose a novel detection method grounded in the observation that facial attributes governed by complex physical laws and multiple parameters are inherently difficult to replicate. Specifically, we focus on illumination, particularly the specular reflection component in the Phong illumination model, which poses the greatest replication challenge due to its parametric complexity and nonlinear formulation. We introduce a fast and accurate face texture estimation method based on Retinex theory to enable precise specular reflection separation. Furthermore, drawing from the mathematical formulation of specular reflection, we posit that forgery evidence manifests not only in the specular reflection itself but also in its relationship with corresponding face texture and direct light. To address this issue, we design the Specular-Reflection-Inconsistency-Network (SRI-Net), incorporating a two-stage cross-attention mechanism to capture these correlations and integrate specular reflection related features with image features for robust forgery detection. Experimental results demonstrate that our method achieves superior performance on both traditional deepfake datasets and generative deepfake datasets, particularly those containing diffusion-generated forgery faces.

伪造检测镜面反射扩散模型图像取证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。