arXiv:2412.07431cs.CVcs.AI2024-12

BENet通过增强伪造面部差异特征,提升跨域假脸检测能力。

BENet: A Cross-domain Robust Network for Detecting Face Forgeries via Bias Expansion and Latent-space Attention

  • 用自编码器扩展偏差特征,强化真伪人脸差异
  • 多尺度注意力模块捕捉伪造不一致,检测细微伪造
  • 支持未知来源伪造检测,适合真实场景应用

针对深度伪造技术的威胁,本文提出BENet——一种跨域鲁棒的假脸检测网络。现有检测器在面对不同生成技术产生的假脸(即不同域)时性能下降,BENet通过基于自编码器的偏差扩展模块,在保留真实人脸特征的同时增强伪造重建的差异,形成可靠的判别偏差。引入潜空间注意力(LSA)模块,捕获多尺度伪造不一致信息,增强对先进伪造技术的鲁棒性。将丰富后的LSA特征与扩展偏差相乘,构建适用于细微伪造检测的通用特征空间。为提升对未知源伪造的检测能力,集成跨域检测模块,在推理时验证面部所属域以提高准确率。采用首次应用于假脸检测的新型偏差扩展损失,实现端到端训练。大量实验表明,BENet在跨数据集和同数据集场景下均优于当前最优方法。

原文摘要 · Abstract (English)

In response to the growing threat of deepfake technology, we introduce BENet, a Cross-Domain Robust Bias Expansion Network. BENet enhances the detection of fake faces by addressing limitations in current detectors related to variations across different types of fake face generation techniques, where ``cross-domain" refers to the diverse range of these deepfakes, each considered a separate domain. BENet's core feature is a bias expansion module based on autoencoders. This module maintains genuine facial features while enhancing differences in fake reconstructions, creating a reliable bias for detecting fake faces across various deepfake domains. We also introduce a Latent-Space Attention (LSA) module to capture inconsistencies related to fake faces at different scales, ensuring robust defense against advanced deepfake techniques. The enriched LSA feature maps are multiplied with the expanded bias to create a versatile feature space optimized for subtle forgeries detection. To improve its ability to detect fake faces from unknown sources, BENet integrates a cross-domain detector module that enhances recognition accuracy by verifying the facial domain during inference. We train our network end-to-end with a novel bias expansion loss, adopted for the first time, in face forgery detection. Extensive experiments covering both intra and cross-dataset demonstrate BENet's superiority over current state-of-the-art solutions.

假脸检测跨域鲁棒注意力机制深度伪造

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。