提出新方法抑制深度伪造检测中的特定捷径,提升跨方法泛化能力。
Suppressing Forgery-Specific Shortcuts for Generalizable Deepfake Detection

- 通过子空间建模识别伪造方法特有特征捷径
- 训练时软抑制捷径子空间,推理时可插件式增强泛化
- 在多数据集上显著提升未知伪造方法的检测效果
深度伪造检测在跨伪造方法时泛化能力差,因现有模型依赖于易失效的方法特异性捷径。尽管近期方法尝试改进泛化性,但缺乏显式识别并抑制学习表征中此类捷径的机制。本文提出快捷路径子空间抑制(S^3)框架,通过子空间建模显式刻画并抑制方法特异性捷径。核心洞察是:区分不同伪造方法的差异能有效捕获方法特异性伪影,可作为捷径的有效代理。为此,我们训练一个轻量级线性探测器进行伪造方法分类,并使用奇异值分解(SVD)提取主导的捷径子空间。基于此,我们设计两种互补策略:训练时在特征表示中软抑制捷径子空间,促使模型依赖更通用线索进行真/假判别;推理时引入无训练替代方案,削弱与已识别捷径方向对齐的神经元,实现即插即用的泛化增强且具备更高可解释性。多个基准测试的广泛实验表明,该方法显著提升跨方法泛化性能,同时保持强域内表现。代码将在录用后发布。
原文摘要 · Abstract (English)
Deepfake detection suffers from poor generalization across forgery methods, as existing models tend to rely on spurious method-specific shortcuts that fail to transfer to unseen manipulations. While recent approaches attempt to improve generalization, they lack an explicit mechanism to identify and suppress such shortcuts in learned representations. In this work, we propose Shortcut Subspace Suppression (S^3) framework that explicitly characterizes and suppresses method-specific shortcuts via subspace modeling. Our key insight is that variations distinguishing different forgery methods capture method-specific artifacts and thus serve as an effective proxy for method-specific shortcuts. To this end, we train a lightweight linear probe for forgery method classification and perform Singular Value Decomposition (SVD) to extract the dominant shortcut subspace. Building on this formulation, we develop two complementary strategies to reduce shortcut reliance. During training, we softly suppress the shortcut subspace in feature representations, encouraging the model to rely on more generalizable cues for real/fake discrimination. At inference time, we introduce a training-free counterpart that attenuates neurons aligned with the identified shortcut directions, enabling plug-and-play generalization enhancement with improved interpretability. Extensive experiments on multiple benchmarks demonstrate that our method significantly improves cross-method generalization while maintaining strong in-domain performance. The code will be released upon acceptance of the submission.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。