提出三分支网络,从频域和空间域联合捕捉伪造特征,提升检测鲁棒性。
Unveiling Deepfakes: A Frequency-Aware Triple Branch Network for Deepfake Detection

- 设计三分支结构,融合原始图像与多频段重建图像的特征
- 在6个基准数据集上达到当前最优性能,准确率超现有方法
- 适合需要高泛化能力的深度伪造检测场景
先进深度伪造技术正模糊真实与虚假的界限,带来应用机遇的同时也引发身份盗用和信息误导等严重社会问题。针对这一挑战,基于频率特征的分析成为检测新方向。然而,现有方法多集中于单一或少数频域,易对特定伪造痕迹过拟合,削弱泛化能力;同时不同特征常聚焦相同伪造区域,导致冗余表示,限制互补信息的提取。本文提出双策略解决方案:(1) 设计三分支网络,通过原始图像与多频段重建图像联合学习空间与频率特征;(2) 基于互信息理论推导特征解耦与融合损失函数,促使模型关注原图与各频段重建图中的任务相关特征。在六个大规模基准数据集上的大量实验表明,本方法持续取得领先性能。代码已开源:https://github.com/injooker/Unveiling Deepfake。
原文摘要 · Abstract (English)
Advanced deepfake technologies are blurring the lines between real and fake, presenting both revolutionary opportunities and alarming threats. While it unlocks novel applications in fields like entertainment and education, its malicious use has sparked urgent ethical and societal concerns ranging from identity theft to the dissemination of misinformation. To tackle these challenges, feature analysis using frequency features has emergedas a promising direction for deepfake detection. However, oneaspect that has been overlooked so far is that existing methodstend to concentrate on one or a few specific frequency domains,which risks overfitting to particular artifacts and significantlyundermines their robustness when facing diverse forgery patterns. Another underexplored aspect we observe is that different features often attend to the same forged region, resulting in redundant feature representations and limiting the diversity of the extracted clues. This may undermine the ability of a model to capture complementary information across different facets, thereby compromising its generalization capability to diverse manipulations. In this paper, we seek to tackle these challenges from two aspects: (1) we propose a triple-branch network that jointly captures spatial and frequency features by learning from both original image and image reconstructed by different frequency channels, and (2) we mathematically derive feature decoupling and fusion losses grounded in the mutual information theory, which enhances the model to focus on task-relevant features across the original image and the image reconstructed by different frequency channels. Extensive experiments on six large-scale benchmark datasets demonstrate that our method consistently achieves state-of-the-art performance. Our code is released at https://github.com/injooker/Unveiling Deepfake.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。