针对人脸攻防检测中真假脸差异小、攻击类型多的问题,提出细粒度专家模型提升识别精度。
Mixture-of-Attack-Experts with Class Regularization for Unified Physical-Digital Face Attack Detection
- 用软专家混合架构让不同专家处理不同类型伪造脸特征
- 在两个数据集上达到当前最佳效果,对异常攻击更敏感
- 适合需要统一检测物理与数字攻击的安防系统开发者
现实场景中的人脸识别系统易受数字和物理攻击。现有方法虽尝试构建综合特征空间分类,但未充分考虑物理与数字攻击数据的内在特性,如攻击类内差异大、活体与伪造脸类间差异小。为此,提出细粒度专家混合带类别感知正则化CLIP框架(FG-MoE-CLIP-CAR),在特征与损失层面双重改进。特征层面采用软专家混合(Soft MoE)架构,使各专家专精处理特定伪造特征,并优化以捕捉细微差异。损失层面引入解耦模块(DM)与聚类蒸馏模块(CDM):DM通过增大活体与伪造脸类别中心间距提升可分性;CDM则强制特征向各自类别中心聚拢并远离其他类别。此外,为避免偏离主流攻击模式的特殊攻击被忽略,距离计算更关注远距离特征。在两个统一物理-数字攻击数据集上的实验表明,该方法性能达当前最优。
原文摘要 · Abstract (English)
Facial recognition systems in real-world scenarios are susceptible to both digital and physical attacks. Previous methods have attempted to achieve classification by learning a comprehensive feature space. However, these methods have not adequately accounted for the inherent characteristics of physical and digital attack data, particularly the large intra class variation in attacks and the small inter-class variation between live and fake faces. To address these limitations, we propose the Fine-Grained MoE with Class-Aware Regularization CLIP framework (FG-MoE-CLIP-CAR), incorporating key improvements at both the feature and loss levels. At the feature level, we employ a Soft Mixture of Experts (Soft MoE) architecture to leverage different experts for specialized feature processing. Additionally, we refine the Soft MoE to capture more subtle differences among various types of fake faces. At the loss level, we introduce two constraint modules: the Disentanglement Module (DM) and the Cluster Distillation Module (CDM). The DM enhances class separability by increasing the distance between the centers of live and fake face classes. However, center-to-center constraints alone are insufficient to ensure distinctive representations for individual features. Thus, we propose the CDM to further cluster features around their respective class centers while maintaining separation from other classes. Moreover, specific attacks that significantly deviate from common attack patterns are often overlooked. To address this issue, our distance calculation prioritizes more distant features. Experimental results on two unified physical-digital attack datasets demonstrate that the proposed method achieves state-of-the-art (SOTA) performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。