arXiv:2503.06187cs.CVcs.AI2025-03

提出MSConv模块,同时捕捉人脸显著与差异特征,提升识别精度。

MSConv: Multiplicative and Subtractive Convolution for Face Recognition

  • 设计乘法与减法卷积,分别提取显著和差异特征
  • 在多个数据集上实现比仅关注显著特征的模型更高准确率
  • 适合需要精细区分相似人脸的场景

在神经网络中,特征融合策略对特征表示效果有显著影响,进而决定模型提取代表性与判别性特征的能力。在人脸识别领域,传统方法包括特征拼接与相加,近年出现了基于注意力机制的融合策略。然而我们发现,这些方法主要关注图像中的显著特征,而忽略了同样重要的另一类特征——本文称之为差异特征。这可能导致模型在处理复杂人脸样本时忽略关键局部差异。为此,本文提出一种高效卷积模块MSConv(Multiplicative and Subtractive Convolution),旨在平衡模型对显著特征与差异特征的学习。具体而言,采用多尺度混合卷积捕获人脸图像的局部与上下文信息,并通过乘法操作(MO)和减法操作(SO)分别提取显著特征与差异特征。实验结果表明,通过融合两类特征,MSConv在性能上优于仅关注显著特征的模型。

原文摘要 · Abstract (English)

In Neural Networks, there are various methods of feature fusion. Different strategies can significantly affect the effectiveness of feature representation, consequently influencing the ability of model to extract representative and discriminative features. In the field of face recognition, traditional feature fusion methods include feature concatenation and feature addition. Recently, various attention mechanism-based fusion strategies have emerged. However, we found that these methods primarily focus on the important features in the image, referred to as salient features in this paper, while neglecting another equally important set of features for image recognition tasks, which we term differential features. This may cause the model to overlook critical local differences when dealing with complex facial samples. Therefore, in this paper, we propose an efficient convolution module called MSConv (Multiplicative and Subtractive Convolution), designed to balance the learning of model about salient and differential features. Specifically, we employ multi-scale mixed convolution to capture both local and broader contextual information from face images, and then utilize Multiplication Operation (MO) and Subtraction Operation (SO) to extract salient and differential features, respectively. Experimental results demonstrate that by integrating both salient and differential features, MSConv outperforms models that only focus on salient features.

人脸识别特征融合卷积模块

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。