通过多路径融合与校准投票,提升深伪检测在真实退化下的稳定性。
Robust Deepfake Detection: Mitigating Spatial Attention Drift via Calibrated Complementary Ensembles

- 构建三路互补流水线,分别捕捉全局纹理、局部人脸与语义融合特征。
- 在极端退化下注意力熵稳定,零样本泛化性能达NTIRE 2026第四名。
- 适合关注真实场景深伪检测鲁棒性的研究人员和应用开发者。
当前深伪检测模型在纯净学术数据集上表现优异,但在真实世界复合退化(如模糊与严重有损压缩)下存在严重空间注意力漂移。为此,我们提出一种基于基础模型的取证框架,结合极端复合退化引擎与结构约束的多流架构。训练中,退化管道系统性破坏高频伪影,优化DINOv2-Giant主干网络以提取不变的几何与语义先验。随后图像通过三个专用路径:全局纹理流、局部人脸流、融合CLIP的混合语义融合流。通过Score-CAM分析空间归因与余弦相似度评估特征稳定性,定量证明各流提取非冗余互补特征并稳定注意力熵。通过校准离散投票机制聚合预测,集成模型有效抑制背景注意力漂移,充当稳健几何锚点。方法实现高度稳定的零样本泛化,在CVPR NTIRE 2026鲁棒深伪检测挑战赛中获第四名。代码已公开于https://github.com/khoalephanminh/ntire26-deepfake-challenge。
原文摘要 · Abstract (English)
Current deepfake detection models achieve state-of-the-art performance on pristine academic datasets but suffer severe spatial attention drift under real-world compound degradations, such as blurring and severe lossy compression. To address this vulnerability, we propose a foundation-driven forensic framework that integrates an extreme compound degradation engine with a structurally constrained, multi-stream architecture. During training, our degradation pipeline systematically destroys high-frequency artifacts, optimizing the DINOv2-Giant backbone to extract invariant geometric and semantic priors. We then process images through three specialized pathways: a Global Texture stream, a Localized Facial stream, and a Hybrid Semantic Fusion stream incorporating CLIP. Through analyzing spatial attribution via Score-CAM and feature stability using Cosine Similarity, we quantitatively demonstrate that these streams extract non-redundant, complementary feature representations and stabilize attention entropy. By aggregating these predictions via a calibrated, discretized voting mechanism, our ensemble successfully suppresses background attention drift while acting as a robust geometric anchor. Our approach yields highly stable zero-shot generalization, achieving Fourth Place in the NTIRE 2026 Robust Deepfake Detection Challenge at CVPR. Code is available at https://github.com/khoalephanminh/ntire26-deepfake-challenge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。