arXiv:2506.04496cs.CV2025-06被引 1

通过反向正脸化增强数据,提升极端姿态下的人脸识别性能。

Towards Large-Scale Pose-Invariant Face Recognition Using Face Defrontalization

  • 提出反向正脸化方法,生成多样姿态人脸用于训练。
  • 在四个公开数据集上超越现有方法,尤其在大尺度数据上表现优异。
  • 适合需要高鲁棒性人脸识别的工业场景应用。

极端头像下的人脸识别是一项挑战性任务。理想的人脸识别系统应具备姿态不变性。当前方法依赖复杂的正脸化技术与特征提取模型架构,但在真实场景中不实用,且多在小规模数据集(如Multi-PIE)上评估。本文提出反向正脸化(face defrontalization)方法,用于扩充面部特征提取模型的训练数据,推理阶段无额外开销。该方法包括:1)基于预处理的正-侧脸配对数据集训练改进的反正脸化模型(FFWM);2)在原始且随机反正脸化的大型数据集上,使用ArcFace损失训练ResNet-50特征提取模型。在LFW、AgeDB、CFP和Multi-PIE四个公开数据集上对比测试,反正脸化显著优于无该处理的模型,且所提方法在三个大尺度数据集上优于当前最先进的正脸化方法,但在小规模Multi-PIE数据集上(极端姿态75°和90°)未占优。结果表明,部分现有方法可能在小数据集上过拟合。

原文摘要 · Abstract (English)

Face recognition under extreme head poses is a challenging task. Ideally, a face recognition system should perform well across different head poses, which is known as pose-invariant face recognition. To achieve pose invariance, current approaches rely on sophisticated methods, such as face frontalization and various facial feature extraction model architectures. However, these methods are somewhat impractical in real-life settings and are typically evaluated on small scientific datasets, such as Multi-PIE. In this work, we propose the inverse method of face frontalization, called face defrontalization, to augment the training dataset of facial feature extraction model. The method does not introduce any time overhead during the inference step. The method is composed of: 1) training an adapted face defrontalization FFWM model on a frontal-profile pairs dataset, which has been preprocessed using our proposed face alignment method; 2) training a ResNet-50 facial feature extraction model based on ArcFace loss on a raw and randomly defrontalized large-scale dataset, where defrontalization was performed with our previously trained face defrontalization model. Our method was compared with the existing approaches on four open-access datasets: LFW, AgeDB, CFP, and Multi-PIE. Defrontalization shows improved results compared to models without defrontalization, while the proposed adjustments show clear superiority over the state-of-the-art face frontalization FFWM method on three larger open-access datasets, but not on the small Multi-PIE dataset for extreme poses (75 and 90 degrees). The results suggest that at least some of the current methods may be overfitted to small datasets.

人脸识别姿态不变数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。