根据人脸特征动态调整检测器,提升深伪视频识别准确率
AdaForensics: Learning A Characteristic-aware Adaptive Deepfake Detector

- 设计双分支超网络,动态生成适配不同人脸的检测参数
- 在FaceForensics、Celeb-DF等数据集上超越现有最优方法
- 适用于个性化深伪检测,尤其对个体差异显著的场景
本文提出一种特征感知自适应网络AdaForensics,用于深伪视频检测。现有方法多采用固定网络结构,无法针对不同个体的人脸特征进行定制化检测。为此,AdaForensics同时学习通用特征与个体特异性嵌入,通过设计的超网络在测试时动态调整检测器参数。该方法不仅捕捉各类深伪图像中的共享抽象特征,还能根据输入人脸特征实时适配检测器。实验在FaceForensics、Celeb-DF和DFDC等主流数据集上验证了其有效性,性能优于当前最先进方法。
原文摘要 · Abstract (English)
In this paper, we propose a characteristic-aware adaptive network named AdaForensics for deepfake detection. Most existing methods learn a fixed network to detect deepfakes based on carefully-designed network architectures. However, these methods employ the same deepfake detector for all the images despite of various facial characteristic, which fail to provide customized forgery detection for different individuals. To address this, our AdaForensics simultaneously learns characteristic-agnostic and characteristic-specific embeddings, where the detector dynamically adapts to varying faces with our designed hypernetwork on the fly. More specifically, our AdaForensics not only explores the shareable abstractions from various deepfake images, but also adapts the detector to the given characteristic at test time. To achieve this, we propose a two-branch HyperNetwork to learn an adaptive deepfake detector, which automatically adjusts the parameters based on characteristic of the input. Extensive experiments on widely-used datasets including FaceForensics, Celeb-DF and DFDC demonstrate our AdaForensics outperforms the state-of-the-art works.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。