arXiv:2510.24640cs.CV2025-10被引 1

用双分支网络同时分析图像和频域特征,提升伪造人脸检测能力。

A Dual-Branch CNN for Robust Detection of AI-Generated Facial Forgeries

  • 分空间与频域两条支路,捕捉语义与高频伪影特征
  • 在DiFF数据集上超越人类平均准确率,四类伪造均表现优异
  • 适合安全、媒体审核等需要高鲁棒性检测的场景

生成式AI的快速发展使伪造人脸图像日益逼真,对AI安全、数字媒体真实性和公众信任构成重大威胁。从人脸替换、属性编辑到基于扩散模型的图像合成,这些技术正被滥用于传播虚假信息、身份欺诈和诽谤。因此,亟需具备鲁棒性和泛化能力的人脸伪造检测方法作为AI安全基础设施。本文提出一种新型双分支卷积神经网络,融合空间域(RGB分支)和频率域(频率分支)的互补线索。前者捕获语义信息,后者聚焦生成模型难以抑制的高频伪影。通过通道注意力模块自适应融合异构特征,突出最具判别力的通道。设计统一损失函数FSC Loss,结合焦点损失、有监督对比损失和频域中心边界损失,增强类别可分性与鲁棒性。在包含四种主流伪造方法(文本到图像、图像到图像、人脸替换、人脸编辑)的DiFF基准上评估,模型在所有类别上均表现强劲,且超过平均人类检测准确率,验证了其有效性及在抵御视觉伪造攻击中的潜力。

原文摘要 · Abstract (English)

The rapid advancement of generative AI has enabled the creation of highly realistic forged facial images, posing significant threats to AI security, digital media integrity, and public trust. Face forgery techniques, ranging from face swapping and attribute editing to powerful diffusion-based image synthesis, are increasingly being used for malicious purposes such as misinformation, identity fraud, and defamation. This growing challenge underscores the urgent need for robust and generalizable face forgery detection methods as a critical component of AI security infrastructure. In this work, we propose a novel dual-branch convolutional neural network for face forgery detection that leverages complementary cues from both spatial and frequency domains. The RGB branch captures semantic information, while the frequency branch focuses on high-frequency artifacts that are difficult for generative models to suppress. A channel attention module is introduced to adaptively fuse these heterogeneous features, highlighting the most informative channels for forgery discrimination. To guide the network's learning process, we design a unified loss function, FSC Loss, that combines focal loss, supervised contrastive loss, and a frequency center margin loss to enhance class separability and robustness. We evaluate our model on the DiFF benchmark, which includes forged images generated from four representative methods: text-to-image, image-to-image, face swap, and face edit. Our method achieves strong performance across all categories and outperforms average human accuracy. These results demonstrate the model's effectiveness and its potential contribution to safeguarding AI ecosystems against visual forgery attacks.

伪造检测双分支网络频域分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。