arXiv:2505.00312cs.CV2025-05被引 4

自适应加权集成提升深伪检测鲁棒性,跨数据集表现更稳定。

AWARE-NET: Adaptive Weighted Averaging for Robust Ensemble Network in Deepfake Detection

  • 三类主流模型各运行三次,通过可学习权重动态融合预测结果。
  • 在FF++和CelebDF-v2上达到99.22%和100%的AUC,无需数据增强。
  • 支持跨数据集泛化,适合实际部署中的多源伪造检测场景。

深度伪造检测因合成媒体泛滥而日益重要,威胁数字身份与网络信任。尽管已有多种方法提升检测精度,但在不同数据集和篡改类型下仍难保持一致性能。为此,我们提出一种基于深度学习的两阶段集成框架,层次化融合Xception、Res2Net101和EfficientNet-B7三种先进架构的多个实例。每类模型以不同初始化运行三次以增强多样性,第一层对同架构预测进行自适应平均以降低方差,第二层通过反向传播学习最优贡献权重,动态调整各架构影响力。实验显示,该框架在无数据增强情况下于FF++和CelebDF-v2上分别取得99.22%与100.00%的AUC,F1达98.06%与99.94%;使用增强后,AUC升至99.47%与100.00%,F1为98.43%与99.95%。跨数据集评估中,其表现稳健,分别获得88.20%与72.52%的AUC,以及93.16%与80.62%的F1。

原文摘要 · Abstract (English)

Deepfake detection has become increasingly important due to the rise of synthetic media, which poses significant risks to digital identity and cyber presence for security and trust. While multiple approaches have improved detection accuracy, challenges remain in achieving consistent performance across diverse datasets and manipulation types. In response, we propose a novel two-tier ensemble framework for deepfake detection based on deep learning that hierarchically combines multiple instances of three state-of-the-art architectures: Xception, Res2Net101, and EfficientNet-B7. Our framework employs a unique approach where each architecture is instantiated three times with different initializations to enhance model diversity, followed by a learnable weighting mechanism that dynamically combines their predictions. Unlike traditional fixed-weight ensembles, our first-tier averages predictions within each architecture family to reduce model variance, while the second tier learns optimal contribution weights through backpropagation, automatically adjusting each architecture's influence based on their detection reliability. Our experiments achieved state-of-the-art intra-dataset performance with AUC scores of 99.22% (FF++) and 100.00% (CelebDF-v2), and F1 scores of 98.06% (FF++) and 99.94% (CelebDF-v2) without augmentation. With augmentation, we achieve AUC scores of 99.47% (FF++) and 100.00% (CelebDF-v2), and F1 scores of 98.43% (FF++) and 99.95% (CelebDF-v2). The framework demonstrates robust cross-dataset generalization, achieving AUC scores of 88.20% and 72.52%, and F1 scores of 93.16% and 80.62% in cross-dataset evaluations.

深伪检测集成学习自适应加权模型融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。