arXiv:2606.20302cs.CV2026-06

用3D纹理图检测名人深度伪造,不依赖训练数据且可解释。

CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection

论文配图:CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection
图 1 · 摘自论文原文
  • 基于3D人脸重建的UV纹理图+MAE自编码,无需伪造视频训练。
  • 在4个数据集上优于当前最好方法,抗压缩和下采样能力最强。
  • 能定位伪造区域,适合需要可解释性的安全场景使用。

针对高影响力人物(POI)的深度伪造威胁现代民主社会。现有方法难以兼顾鲁棒性、效率与可解释性。本文提出CUPID,结合从3D人脸重建中提取的UV纹理图与掩码自编码器(MAE)的表征学习能力,实现无需任何深度伪造视频训练,也无需将特定POI纳入训练集。通过真实视频帧提取的UV纹理图与MAE上下文引导重建,构建出对未见身份仍具判别力的潜在空间。测试时,将查询视频嵌入向量与原始参考视频比对以评估真实性。此外,操作于UV空间天然支持可解释性:可通过解码残差图定位测试视频中偏离目标身份最显著的面部区域。在四个深度伪造数据集上的实验表明,CUPID在多数数据集上超越当前最佳方法,整体对强下采样和压缩具有最优鲁棒性,并实现显著更快推理速度。代码将于https://github.com/polimi-ispl/CUPID发布。

原文摘要 · Abstract (English)

Deepfakes targeting a high-profile individual, known as Person-of-Interest (POI), are a threat to modern democracies and societies. Current POI deepfake detection methods still struggle to combine robustness to post-processing, efficiency and interpretability, key aspects of modern deepfake detectors. In this paper we propose CUPID, a POI video deepfake detector that combines UV texture maps, a facial appearance representation derived from 3D face reconstructions, with the representation learning capabilities of the Masked Autoencoder (MAE). Our method does not require any deepfake videos in its training phase. Moreover, it does not even require including a specific POI in the training set: the combination of UV texture maps extracted from real video frames and the MAE context-guided reconstruction yields a latent space that captures rich and discriminative facial features even for identities unseen during training. In the testing phase, the embeddings extracted from a query video depicting the POI can be matched against pristine reference videos to assess the video authenticity. Furthermore, operating in the UV space naturally provides an additional layer of interpretability. Specifically, we can extract decoded residual maps that highlight which facial regions of a test video deviate most from the identity representation of the corresponding POI. Experiments on four deepfake datasets show that CUPID outperforms the current state of the art on most datasets and achieves the best overall robustness against strong downscaling and compression, while also providing substantially faster inference. Our experimental code will be released at https://github.com/polimi-ispl/CUPID.

深度伪造检测可解释性3D人脸重建UV纹理图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。