arXiv:2410.10244cs.CV2024-10被引 3

通过渐进式解耦与净化混合身份,更精准捕捉伪造人脸中的异常特征。

Capture Artifacts via Progressive Disentangling and Purifying Blended Identities for Deepfake Detection

  • 分两阶段解耦:先粗后细,无需标注即可分离源脸与目标脸
  • 设计相关性压缩模块,显著降低身份与伪影间的干扰关联
  • 适合需要跨数据集泛化的深度伪造检测场景

深度伪造技术引发了隐私泄露和信任危机。现有检测方法过度依赖全局特征空间,其中包含与伪造痕迹无关的冗余信息,导致在未知数据集上性能下降。当前解耦方法缺乏可靠基础,难以保证分离结果的可信度。为此,本文提出一种基于渐进式解耦与净化混合身份的深度伪造检测方法。基于伪造生成机制,结合粗粒度与细粒度策略,确保解耦可靠性。首先对伪造人脸进行粗粒度解耦,获得无需额外标注即可区分的源脸与目标脸混合身份;随后从每个身份中分离出伪影特征,实现细粒度解耦。基于信息瓶颈理论,设计身份-伪影相关性压缩模块(IACC),有效降低身份信息与伪影之间的潜在关联。同时引入身份-伪影分离对比损失,增强解耦后伪影特征的独立性。最终分类器仅关注纯净的伪影特征,实现具有强泛化能力的深度伪造检测。

原文摘要 · Abstract (English)

The Deepfake technology has raised serious concerns regarding privacy breaches and trust issues. To tackle these challenges, Deepfake detection technology has emerged. Current methods over-rely on the global feature space, which contains redundant information independent of the artifacts. As a result, existing Deepfake detection techniques suffer performance degradation when encountering unknown datasets. To reduce information redundancy, the current methods use disentanglement techniques to roughly separate the fake faces into artifacts and content information. However, these methods lack a solid disentanglement foundation and cannot guarantee the reliability of their disentangling process. To address these issues, a Deepfake detection method based on progressive disentangling and purifying blended identities is innovatively proposed in this paper. Based on the artifact generation mechanism, the coarse- and fine-grained strategies are combined to ensure the reliability of the disentanglement method. Our method aims to more accurately capture and separate artifact features in fake faces. Specifically, we first perform the coarse-grained disentangling on fake faces to obtain a pair of blended identities that require no additional annotation to distinguish between source face and target face. Then, the artifact features from each identity are separated to achieve fine-grained disentanglement. To obtain pure identity information and artifacts, an Identity-Artifact Correlation Compression module (IACC) is designed based on the information bottleneck theory, effectively reducing the potential correlation between identity information and artifacts. Additionally, an Identity-Artifact Separation Contrast Loss is designed to enhance the independence of artifact features post-disentangling. Finally, the classifier only focuses on pure artifact features to achieve a generalized Deepfake detector.

深度伪造检测特征解耦泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。