提出环境不变子空间学习,提升深伪检测在不同光照风格下的泛化能力。
Environment-Invariant Subspace Learning for Generalizable Deepfake Detection

- 通过低秩投影分离伪造特征与环境因素
- 在跨数据集、跨生成器等场景下性能领先
- 适合需要鲁棒深伪检测的工业应用
跨分布泛化仍是深伪检测的关键瓶颈。尽管近期工作利用大规模视觉基础模型(VFMs)的语义先验,但一个值得关注却未被充分探索的问题是:这些语义先验易受光照、风格等环境因素干扰。这种干扰导致伪造线索与环境模式之间建立虚假相关,严重限制泛化能力。为此,我们提出环境不变子空间学习(EISL)框架,核心是通过可学习的低秩投影,将特征分解为正交的伪造相关不变因子与环境相关残差因子。为实现鲁棒特征解耦,设计了环境干预模块,生成多样且具挑战性的干预对,模拟分布外环境变化,引导模型发现真正不变的伪造表征。在跨数据集、跨生成器、全脸合成及噪声扰动设置下实验均显示一致提升,性能优于或媲美强基准检测器,证明其对未见伪造类型和环境变化的鲁棒性。本工作为理解并突破视觉基础模型在深伪检测中的泛化障碍提供了新视角与有价值探索。
原文摘要 · Abstract (English)
Cross-distribution generalization remains a critical bottleneck in deepfake detection. While recent efforts leverage the semantic priors of large-scale visual foundation models (VFMs), a noteworthy yet underexplored challenge remains: the susceptibility of these semantic priors to environmental interference from factors such as lighting and style. Crucially, this interference establishes spurious correlations between forgery cues and environmental patterns that severely limit generalization. To address this fundamental challenge, we propose an innovative Environment-Invariant Subspace Learning (EISL) framework. The core contribution of EISL is that it aims to disentangle features into orthogonal forgery-relevant invariant factors and environment-related residual factors via a learnable low-rank projection. To facilitate robust feature disentanglement, we also design an Environmental Intervention module that generates diverse and challenging intervention pairs, simulating out-of-distribution environmental shifts to guide the model toward discovering truly invariant forgery representations. Experiments across cross-dataset, cross-generator, whole-face synthesis, and corruption settings show consistent gains and competitive or leading performance against strong detectors, demonstrating improved robustness to unseen forgery types and environmental variations. This work provides a new perspective and a valuable exploration for understanding and tackling the generalization barriers of VFMs in deepfake detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。