arXiv:2409.03530cs.CVcs.CR2024-09

用三元组损失提升低分辨率人脸还原,让识别更准

Use of triplet loss for facial restoration in low-resolution images

  • 用三元组损失训练超分模型,聚焦保身份而非单纯画质
  • 在14×14到56×56像素下,d'最高达3.049,识别率显著提升
  • 仅用真实图像训练,适合实际场景部署

近年来,人脸识别(FR)模型已成为最广泛应用的生物特征工具,在多个数据集上取得优异表现。然而,硬件限制或拍摄距离常导致低分辨率图像,严重降低FR模型性能。为此,已有多种超分辨率(SR)模型被提出以生成高分辨率人脸。尽管如此,FR算法性能仍无显著提升。本文提出新型SR模型FTLGAN,专注于生成保留个体身份的高分辨率图像,从而最大化FR模型性能。实验结果表明,其在14×14、28×28和56×56像素下的平均d'值分别达到1.099、2.112和3.049,对应AUC为0.78、0.92和0.98,较当前最佳模型提升21%。该方法在所有分辨率下均表现出一致优越性能,且仅需真实图像训练,无需合成数据,显著拓展实际应用潜力。同时,首次将人脸识别质量作为损失函数引入模型训练,直接优化分类性能。

原文摘要 · Abstract (English)

In recent years, facial recognition (FR) models have become the most widely used biometric tool, achieving impressive results on numerous datasets. However, inherent hardware challenges or shooting distances often result in low-resolution images, which significantly impact the performance of FR models. To address this issue, several solutions have been proposed, including super-resolution (SR) models that generate highly realistic faces. Despite these efforts, significant improvements in FR algorithms have not been achieved. We propose a novel SR model FTLGAN, which focuses on generating high-resolution images that preserve individual identities rather than merely improving image quality, thereby maximizing the performance of FR models. The results are compelling, demonstrating a mean value of d' 21% above the best current state-of-the-art models, specifically having a value of d' = 1.099 and AUC = 0.78 for 14x14 pixels, d' = 2.112 and AUC = 0.92 for 28x28 pixels, and d' = 3.049 and AUC = 0.98 for 56x56 pixels. The contributions of this study are significant in several key areas. Firstly, a notable improvement in facial recognition performance has been achieved in low-resolution images, specifically at resolutions of 14x14, 28x28, and 56x56 pixels. Secondly, the enhancements demonstrated by FTLGAN show a consistent response across all resolutions, delivering outstanding performance uniformly, unlike other comparative models. Thirdly, an innovative approach has been implemented using triplet loss logic, enabling the training of the super-resolution model solely with real images, contrasting with current models, and expanding potential real-world applications. Lastly, this study introduces a novel model that specifically addresses the challenge of improving classification performance in facial recognition systems by integrating facial recognition quality as a loss during model training.

人脸恢复超分辨率三元组损失人脸识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。