提出新方法,让AI能自动适应未知伪造技术。
Forgery Guided Learning Strategy with Dual Perception Network for Deepfake Cross-domain Detection
- 用差异感知策略动态调整模型学习方向。
- 在多个数据集上检测准确率超现有方法,跨域效果显著。
- 适合需要应对快速迭代伪造技术的安全部门和平台。
深度伪造技术的兴起引发了一系列社会问题,引发广泛关注。当前的深度伪造检测方法在特定数据集上表现良好,但在面对未知伪造技术的数据集时性能下降。随着新兴伪造技术与传统技术差距扩大,依赖通用伪造痕迹的跨域检测方法日益失效。这凸显了发展具备强泛化能力的深度伪造检测技术以应对快速迭代伪造技术的紧迫性。为此,我们提出一种伪造引导学习(FGL)策略,使检测网络能够持续适应未知伪造技术。该策略捕捉已知与未知伪造技术间的差异信息,实现模型学习过程的实时动态调整。为进一步提升对伪造痕迹的感知能力,设计双感知网络(DPNet),同时捕获伪造痕迹间的差异与关联。在频域分支中,网络动态感知并提取各类伪造技术的判别特征,构建关键检测线索;这些特征与空间特征融合后投影至嵌入空间。此外,采用图卷积感知整个特征空间中的关系,促进对伪造痕迹关联性的全面理解。大量实验表明,所提方法在不同场景下具有优异泛化能力,有效应对未知伪造挑战,为深度伪造检测提供稳健支持。代码已开源:https://github.com/vpsg-research/FGL。
原文摘要 · Abstract (English)
The emergence of deepfake technology has introduced a range of societal problems, garnering considerable attention. Current deepfake detection methods perform well on specific datasets, but exhibit poor performance when applied to datasets with unknown forgery techniques. Moreover, as the gap between emerging and traditional forgery techniques continues to widen, cross-domain detection methods that rely on common forgery traces are becoming increasingly ineffective. This situation highlights the urgency of developing deepfake detection technology with strong generalization to cope with fast iterative forgery techniques. To address these challenges, we propose a Forgery Guided Learning (FGL) strategy designed to enable detection networks to continuously adapt to unknown forgery techniques. Specifically, the FGL strategy captures the differential information between known and unknown forgery techniques, allowing the model to dynamically adjust its learning process in real time. To further improve the ability to perceive forgery traces, we design a Dual Perception Network (DPNet) that captures both differences and relationships among forgery traces. In the frequency stream, the network dynamically perceives and extracts discriminative features across various forgery techniques, establishing essential detection cues. These features are then integrated with spatial features and projected into the embedding space. In addition, graph convolution is employed to perceive relationships across the entire feature space, facilitating a more comprehensive understanding of forgery trace correlations. Extensive experiments show that our approach generalizes well across different scenarios and effectively handles unknown forgery challenges, providing robust support for deepfake detection. Our code is available on https://github.com/vpsg-research/FGL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。