arXiv:2501.09817cs.CVcs.AI2025-01CVPR被引 23

用视觉变压器检测单张人脸伪造攻击,通用性强且效果更好。

Generalized Single-Image-Based Morphing Attack Detection Using Deep Representations from Vision Transformer

  • 基于视觉变压器学习全局与局部特征,捕捉散布在人脸各处的伪造痕迹。
  • 跨数据集测试下性能优于现有方法,同数据集测试表现相当。
  • 适合部署于边境管控等真实场景,应对未知伪造手段。

人脸伪装攻击对边境管控和护照签发等场景中的人脸识别系统构成严重威胁。为防御此类攻击,需具备泛化能力的单图像伪装检测算法(S-MAD)。现有方法在面对不同生成算法、后处理及打印/扫描设备差异时表现不稳定。本文提出一种基于视觉变压器(ViT)的S-MAD方法,利用其整合局部与全局信息的能力,有效识别广泛分布于人脸区域的伪装痕迹。在公开的FRGC数据集生成的多个伪装数据集上进行大量实验,对比了多种先进检测算法。结果表明,该方法在跨数据集测试中显著提升检测性能,而在同数据集测试中保持相当水平,展现出优异的泛化能力。

原文摘要 · Abstract (English)

Face morphing attacks have posed severe threats to Face Recognition Systems (FRS), which are operated in border control and passport issuance use cases. Correspondingly, morphing attack detection algorithms (MAD) are needed to defend against such attacks. MAD approaches must be robust enough to handle unknown attacks in an open-set scenario where attacks can originate from various morphing generation algorithms, post-processing and the diversity of printers/scanners. The problem of generalization is further pronounced when the detection has to be made on a single suspected image. In this paper, we propose a generalized single-image-based MAD (S-MAD) algorithm by learning the encoding from Vision Transformer (ViT) architecture. Compared to CNN-based architectures, ViT model has the advantage on integrating local and global information and hence can be suitable to detect the morphing traces widely distributed among the face region. Extensive experiments are carried out on face morphing datasets generated using publicly available FRGC face datasets. Several state-of-the-art (SOTA) MAD algorithms, including representative ones that have been publicly evaluated, have been selected and benchmarked with our ViT-based approach. Obtained results demonstrate the improved detection performance of the proposed S-MAD method on inter-dataset testing (when different data is used for training and testing) and comparable performance on intra-dataset testing (when the same data is used for training and testing) experimental protocol.

人脸伪造ViT安全检测跨数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。