arXiv:2603.21939cs.CVcs.MM2026-03

通过特征蒸馏增强多专家集成,提升伪造图像检测的鲁棒性与泛化能力。

FeatDistill: A Feature Distillation Enhanced Multi-Expert Ensemble Framework for Robust AI-generated Image Detection

  • 采用四分支ViT集成架构,融合CLIP与SigLIP捕捉互补伪造线索。
  • 引入两阶段训练:先分类优化,再通过特征级自蒸馏对齐语义表示。
  • 在复杂退化与未知生成器下表现稳定,适合真实场景深度伪造检测。

深度伪造技术的快速迭代与广泛传播给信息安全带来严峻挑战,构建鲁棒且泛化的AI生成图像检测方法愈发重要。本文提出FeatDistill框架,结合特征蒸馏与多专家集成,专为NTIRE挑战赛‘野外’鲁棒AI生成图像检测设计。该框架针对真实取证中的三大瓶颈:退化干扰、特征表达不足与泛化能力弱。具体地,构建由CLIP与SigLIP变体组成的四分支视觉变换器(ViT)集成模型,以捕获互补的鉴伪线索。为扩大数据覆盖,扩充训练集并引入全面的退化建模,使检测器暴露于多样质量变化与合成伪影中。采用两阶段训练策略:先用标准二分类目标优化模型,再通过密集特征级自蒸馏进行表征对齐,有效缓解过拟合并增强学习特征的语义一致性。推理时,通过对四个独立训练专家的概率取平均,实现对未见生成器和复杂退化场景下的稳定可靠决策。尽管采用集成设计,框架仍保持高效,峰值显存仅约10 GB。在NTIRE挑战赛设定下的大量评估表明,FeatDistill在多种‘野外’条件下展现出强鲁棒性与泛化能力,为真实世界深度伪造图像检测提供了有效且实用的解决方案。

原文摘要 · Abstract (English)

The rapid iteration and widespread dissemination of deepfake technology have posed severe challenges to information security, making robust and generalizable detection of AI-generated forged images increasingly important. In this paper, we propose FeatDistill, an AI-generated image detection framework that integrates feature distillation with a multi-expert ensemble, developed for the NTIRE Challenge on Robust AI-Generated Image Detection in the Wild. The framework explicitly targets three practical bottlenecks in real-world forensics: degradation interference, insufficient feature representation, and limited generalization. Concretely, we build a four-backbone Vision Transformer (ViT) ensemble composed of CLIP and SigLIP variants to capture complementary forensic cues. To improve data coverage, we expand the training set and introduce comprehensive degradation modeling, which exposes the detector to diverse quality variations and synthesis artifacts commonly encountered in unconstrained scenarios. We further adopt a two-stage training paradigm: the model is first optimized with a standard binary classification objective, then refined by dense feature-level self-distillation for representation alignment. This design effectively mitigates overfitting and enhances semantic consistency of learned features. At inference time, the final prediction is obtained by averaging the probabilities from four independently trained experts, yielding stable and reliable decisions across unseen generators and complex degradations. Despite the ensemble design, the framework remains efficient, requiring only about 10 GB peak GPU memory. Extensive evaluations in the NTIRE challenge setting demonstrate that FeatDistill achieves strong robustness and generalization under diverse ``in-the-wild'' conditions, offering an effective and practical solution for real-world deepfake image detection.

伪造检测多专家集成特征蒸馏ViT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。