用Transformer增强损失函数,让人脸识别更抗老化
Age-Defying Face Recognition with Transformer-Enhanced Loss
- 将Transformer引入损失函数,捕捉人脸随年龄变化的时序特征
- 在LFW、CA-LFW和AgeDB上达到当前最佳性能
- 适合长期身份识别与跨年龄人脸识别场景
衰老给人脸识别带来显著挑战,因皮肤纹理与色调变化会改变面部特征,尤其在相隔数年的图像比对中。本文提出一种基于Transformer的增强型损失函数,将主干CNN网络最后一层的输出序列化为上下文向量,输入Transformer编码器以建模随年龄演变的空间关系。该方法能有效缓解皱纹、皮肤松弛等老化影响,学习更具年龄不变性的特征表示,同时补充标准度量损失的判别能力。实验表明,结合多种基础度量损失函数后,该模型在LFW、CA-LFW和AgeDB数据集上均取得当前最优结果,拓展了Transformer在机器视觉中的应用边界。
原文摘要 · Abstract (English)
Aging presents a significant challenge in face recognition, as changes in skin texture and tone can alter facial features over time, making it particularly difficult to compare images of the same individual taken years apart, such as in long-term identification scenarios. Transformer networks have the strength to preserve sequential spatial relationships caused by aging effect. This paper presents a technique for loss evaluation that uses a transformer network as an additive loss in the face recognition domain. The standard metric loss function typically takes the final embedding of the main CNN backbone as its input. Here, we employ a transformer-metric loss, a combined approach that integrates both transformer-loss and metric-loss. This research intends to analyze the transformer behavior on the convolution output when the CNN outcome is arranged in a sequential vector. These sequential vectors have the potential to overcome the texture or regional structure referred to as wrinkles or sagging skin affected by aging. The transformer encoder takes input from the contextual vectors obtained from the final convolution layer of the network. The learned features can be more age-invariant, complementing the discriminative power of the standard metric loss embedding. With this technique, we use transformer loss with various base metric-loss functions to evaluate the effect of the combined loss functions. We observe that such a configuration allows the network to achieve SoTA results in LFW and age-variant datasets (CA-LFW and AgeDB). This research expands the role of transformers in the machine vision domain and opens new possibilities for exploring transformers as a loss function.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。