利用未知来源的假脸数据,提升深度伪造检测泛化能力
Leveraging Unlabeled Data from Unknown Sources via Dual-Path Guidance for Deepfake Face Detection
- 通过双路径机制对齐不同生成模型的假脸特征
- 动态生成伪标签,有效利用海量无标签数据
- 特别适合应对真实感极强且来源未知的深度伪造
现有深度伪造检测方法严重依赖静态标注数据集。随着生成模型普及,现实场景中充斥着大量来自未知来源的未标注假脸数据,这带来严峻挑战:仅依赖已有数据的检测器会出现泛化失效,而人工标注这些高真实感伪造内容又不现实。更根本的问题在于,真实与虚假人脸语义相同,传统无监督方法在此场景下性能下降。为此,本文提出双路径引导网络(DPGNet),解决两大难题:(1) 弥合不同生成模型间假脸的域差异;(2) 利用未标注图像样本。方法包含两个核心模块:文本引导的跨域对齐,通过可学习提示将视觉与文本嵌入统一到域不变特征空间;课程驱动的伪标签生成,动态利用未标注样本。在多个主流数据集上的大量实验表明,DPGNet显著优于现有技术,验证了其在利用未标注数据应对深度伪造挑战中的有效性。
原文摘要 · Abstract (English)
Existing deepfake detection methods heavily rely on static labeled datasets. However, with the proliferation of generative models, real-world scenarios are flooded with massive amounts of unlabeled fake face data from unknown sources. This presents a critical dilemma: detectors relying solely on existing data face generalization failure, while manual labeling for this new stream is infeasible due to the high realism of fakes. A more fundamental challenge is that, unlike typical unsupervised learning tasks where categories are clearly defined, real and fake faces share the same semantics, which leads to a decline in the performance of traditional unsupervised strategies. Therefore, there is an urgent need for a new paradigm designed specifically for this scenario to effectively utilize these unlabeled data. Accordingly, this paper proposes a dual-path guided network (DPGNet) to address two key challenges: (1) bridging the domain differences between faces generated by different generative models; and (2) utilizing unlabeled image samples. The method comprises two core modules: text-guided cross-domain alignment, which uses learnable cues to unify visual and textual embeddings into a domain-invariant feature space; and curriculum-driven pseudo-label generation, which dynamically utilizes unlabeled samples. Extensive experiments on multiple mainstream datasets show that DPGNet significantly outperforms existing techniques,, highlighting its effectiveness in addressing the challenges posed by the deepfakes using unlabeled data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。