arXiv:2512.12667cs.CV2025-12AAAI被引 9

新方法解决未知伪造视频归属难题,提升真实场景识别能力。

Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning

  • 用动态置信度调节机制缓解未知伪造的伪标签偏差
  • 自动估算未知伪造类型数量,无需事先假设
  • 适合应对现实世界中不断涌现的新式深度伪造

合成人脸图像的泛滥加剧了对开放世界深度伪造归属(OW-DFA)的需求,旨在利用已知伪造类型的标注数据和混合了已知与未知类型的未标注数据,同时识别已知和未知伪造。现有方法存在两大缺陷:一是置信度偏移导致未知伪造的伪标签不可靠,引发训练偏差;二是不切实际地假设未知伪造类型数已知。为此,本文提出置信度感知的非对称学习(CAL)框架,通过自适应平衡已知与未知伪造类型的模型置信度来应对挑战。CAL包含两个核心组件:置信度感知一致性正则化(CCR)通过归一化置信度动态调整样本损失,逐步将训练重点从高置信度样本转向低置信度样本;非对称置信度强化(ACR)则通过选择性学习高置信度样本,分别校准已知与未知类别的置信度,基于其置信度差距进行引导。二者形成相互增强的闭环,显著提升模型性能。此外,提出动态原型剪枝(DPP)策略,以粗到精方式自动估计未知伪造类型数量,消除不合理先验假设,增强方法在真实场景下的可扩展性。在标准OW-DFA基准及新增包含先进篡改技术的基准上,实验表明CAL持续优于现有方法,在已知与未知伪造归属任务上均达到新最佳性能。

原文摘要 · Abstract (English)

The proliferation of synthetic facial imagery has intensified the need for robust Open-World DeepFake Attribution (OW-DFA), which aims to attribute both known and unknown forgeries using labeled data for known types and unlabeled data containing a mixture of known and novel types. However, existing OW-DFA methods face two critical limitations: 1) A confidence skew that leads to unreliable pseudo-labels for novel forgeries, resulting in biased training. 2) An unrealistic assumption that the number of unknown forgery types is known *a priori*. To address these challenges, we propose a Confidence-Aware Asymmetric Learning (CAL) framework, which adaptively balances model confidence across known and novel forgery types. CAL mainly consists of two components: Confidence-Aware Consistency Regularization (CCR) and Asymmetric Confidence Reinforcement (ACR). CCR mitigates pseudo-label bias by dynamically scaling sample losses based on normalized confidence, gradually shifting the training focus from high- to low-confidence samples. ACR complements this by separately calibrating confidence for known and novel classes through selective learning on high-confidence samples, guided by their confidence gap. Together, CCR and ACR form a mutually reinforcing loop that significantly improves the model's OW-DFA performance. Moreover, we introduce a Dynamic Prototype Pruning (DPP) strategy that automatically estimates the number of novel forgery types in a coarse-to-fine manner, removing the need for unrealistic prior assumptions and enhancing the scalability of our methods to real-world OW-DFA scenarios. Extensive experiments on the standard OW-DFA benchmark and a newly extended benchmark incorporating advanced manipulations demonstrate that CAL consistently outperforms previous methods, achieving new state-of-the-art performance on both known and novel forgery attribution.

深度伪造归属识别开放世界置信度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。