arXiv:2505.04384cs.CV2025-05中稿 · IEEE TMM on 17-Jan…被引 8

提出新框架DATA,提升开放世界深伪图像归属的泛化能力。

DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution

  • 分离方法特有与通用伪造特征,减少过拟合
  • 引入增强记忆机制,提升新类别识别准确率
  • 适合处理未知深伪技术的开放世界场景

深伪图像归属(DFA)旨在对不同人脸篡改技术进行多分类,以减轻伪造内容对社会秩序和个人声誉的负面影响。然而,以往方法仅关注特定方法线索,易导致过拟合,忽视了通用伪造特征的重要性,且在更贴近实际的开放世界场景中难以区分不确定的新类别。为此,本文提出一种基于多解耦的对比学习框架DATA,以增强开放世界半监督深伪图像归属(OSS-DFA)任务中对新类别的泛化能力。具体而言,由于所有生成技术可抽象为相似架构,DATA首次定义‘正交深伪基’概念,用于解耦方法特有特征,从而降低对无关信息的过拟合。同时,设计增强记忆机制辅助新类别发现与对比学习,通过实例级解耦获得清晰的新类别边界。此外,为增强特征标准化与判别性,使用基对比损失和中心对比损失作为辅助。大量实验表明,DATA在OSS-DFA基准上达到领先性能,不同设置下准确率分别提升2.55%与5.7%。

原文摘要 · Abstract (English)

Deepfake attribution (DFA) aims to perform multiclassification on different facial manipulation techniques, thereby mitigating the detrimental effects of forgery content on the social order and personal reputations. However, previous methods focus only on method-specific clues, which easily lead to overfitting, while overlooking the crucial role of common forgery features. Additionally, they struggle to distinguish between uncertain novel classes in more practical open-world scenarios. To address these issues, in this paper we propose an innovative multi-DisentAnglement based conTrastive leArning framework, DATA, to enhance the generalization ability on novel classes for the open-world semi-supervised deepfake attribution (OSS-DFA) task. Specifically, since all generation techniques can be abstracted into a similar architecture, DATA defines the concept of 'Orthonormal Deepfake Basis' for the first time and utilizes it to disentangle method-specific features, thereby reducing the overfitting on forgery-irrelevant information. Furthermore, an augmented-memory mechanism is designed to assist in novel class discovery and contrastive learning, which aims to obtain clear class boundaries for the novel classes through instance-level disentanglements. Additionally, to enhance the standardization and discrimination of features, DATA uses bases contrastive loss and center contrastive loss as auxiliaries for the aforementioned modules. Extensive experimental evaluations show that DATA achieves state-of-the-art performance on the OSS-DFA benchmark, e.g., there are notable accuracy improvements in 2.55% / 5.7% under different settings, compared with the existing methods.

深伪检测对比学习开放世界解耦表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。