arXiv:2508.06248cs.CV2025-08被引 25

仅微调0.03%参数,就能让深伪检测模型跨数据集泛化更强。

Deepfake Detection that Generalizes Across Benchmarks

  • 只调整层归一化参数,结合球形特征约束提升泛化能力
  • 在14个数据集上平均跨域AUROC达当前最优
  • 适合追求高效、可复现检测方案的研究者与应用团队

深伪检测模型在面对未见过的伪造技术时泛化能力仍是一大挑战。尽管许多方法通过引入复杂结构来适配基础模型,本文证明:仅对一个预训练视觉编码器进行参数高效的调整,即可实现稳健的泛化。所提方法GenD仅微调层归一化参数(占总参数量0.03%),并通过L2归一化和度量学习强制特征分布呈超球面结构,增强泛化性能。我们在涵盖2019至2025年的14个基准数据集上进行了全面评估,结果表明该方法在平均跨数据集AUROC上超越更复杂、近期的先进方法。分析得出两大核心发现:1)使用同一视频源的真伪配对数据训练是缓解捷径学习、提升泛化的关键;2)学术数据集的检测难度并未随时间严格上升,早期多样化的数据集训练出的模型仍具备强泛化能力。本工作提供了一种计算高效且可复现的方案,证实通过针对性、极小改动预训练图像编码器,即可实现顶尖泛化效果。代码地址:https://github.com/yermandy/GenD

原文摘要 · Abstract (English)

The generalization of deepfake detectors to unseen manipulation techniques remains a challenge for practical deployment. Although many approaches adapt foundation models by introducing significant architectural complexity, this work demonstrates that robust generalization is achievable through a parameter-efficient adaptation of one of the foundational pre-trained vision encoders. The proposed method, GenD, fine-tunes only the Layer Normalization parameters (0.03% of the total) and enhances generalization by enforcing a hyperspherical feature manifold using L2 normalization and metric learning on it. We conducted an extensive evaluation on 14 benchmark datasets spanning from 2019 to 2025. The proposed method achieves state-of-the-art performance, outperforming more complex, recent approaches in average cross-dataset AUROC. Our analysis yields two primary findings for the field: 1) training on paired real-fake data from the same source video is essential for mitigating shortcut learning and improving generalization, and 2) detection difficulty on academic datasets has not strictly increased over time, with models trained on older, diverse datasets showing strong generalization capabilities. This work delivers a computationally efficient and reproducible method, proving that state-of-the-art generalization is attainable by making targeted, minimal changes to a pre-trained foundational image encoder model. The code is at: https://github.com/yermandy/GenD

深伪检测泛化能力轻量化特征空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。