通过人脸左右对称性提升人脸识别性能
SymFace: Additional Facial Symmetry Loss for Deep Face Recognition

- 将人脸垂直分割,强制左右半脸嵌入向量靠近
- 在多个模型上实现性能提升,达到当前最优
- 适合关注人脸识别泛化能力的研究者
过去十年,深度学习方法显著提升了人脸识别算法的性能。损失函数在解决人脸验证问题中起着关键作用,现有方法主要关注类内差异或类间分离。本文研究人脸自然对称性在人脸验证中的应用,将人脸图像垂直分为左右两半,基于对称性假设:左右半脸输出的嵌入向量应在嵌入空间中尽可能接近。为此,设计对称性损失函数,惩罚对称对嵌入之间的差异。该损失能有效抑制表情、光照等导致的微小不对称特征,显著增加类间方差,生成更可靠的面部嵌入。该损失函数在所有主流网络架构和配置下均能超越基线性能,实现当前最优(SoTA)结果。
原文摘要 · Abstract (English)
Over the past decade, there has been a steady advancement in enhancing face recognition algorithms leveraging advanced machine learning methods. The role of the loss function is pivotal in addressing face verification problems and playing a game-changing role. These loss functions have mainly explored variations among intra-class or inter-class separation. This research examines the natural phenomenon of facial symmetry in the face verification problem. The symmetry between the left and right hemi faces has been widely used in many research areas in recent decades. This paper adopts this simple approach judiciously by splitting the face image vertically into two halves. With the assumption that the natural phenomena of facial symmetry can enhance face verification methodology, we hypothesize that the two output embedding vectors of split faces must project close to each other in the output embedding space. Inspired by this concept, we penalize the network based on the disparity of embedding of the symmetrical pair of split faces. Symmetrical loss has the potential to minimize minor asymmetric features due to facial expression and lightning conditions, hence significantly increasing the inter-class variance among the classes and leading to more reliable face embedding. This loss function propels any network to outperform its baseline performance across all existing network architectures and configurations, enabling us to achieve SoTA results.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。