arXiv:2508.13957cs.CV2025-08ICCV被引 8

用视觉变压器提升人脸图像质量评估,效果领先。

ViT-FIQA: Assessing Face Image Quality using Vision Transformers

  • 在ViT中加入可学习的质量标记,融合全局上下文信息
  • 在多个基准上表现顶尖,优于传统CNN方法
  • 适合关注人脸质量评估与Transformer应用的研究者

人脸图像质量评估(FIQA)旨在预测人脸图像对人脸识别(FR)系统的可用性。现有先进方法主要依赖卷积神经网络(CNN),而视觉变换器(ViT)架构的潜力尚未被充分挖掘。本文提出ViT-FIQA,通过在原为人脸识别优化的标准ViT主干网络中引入一个可学习的质量标记,实现对任意人脸图像的实用性评分预测。该质量标记与图像块标记拼接后,经由ViT编码器的全局自注意力机制,聚合所有图像块的上下文信息。在主干输出端,模型分为两个分支:(1) 将图像块标记通过全连接层,利用带惩罚项的软最大值损失学习判别性人脸表示;(2) 将质量标记输入回归头,学习预测人脸样本的实用度。在多个挑战性基准及多种人脸识别模型(包括基于CNN和ViT的架构)上的大量实验表明,ViT-FIQA持续达到顶级性能,验证了基于Transformer架构建模人脸图像实用性的有效性,并凸显了其作为未来FIQA研究可扩展基础的潜力。

原文摘要 · Abstract (English)

Face Image Quality Assessment (FIQA) aims to predict the utility of a face image for face recognition (FR) systems. State-of-the-art FIQA methods mainly rely on convolutional neural networks (CNNs), leaving the potential of Vision Transformer (ViT) architectures underexplored. This work proposes ViT-FIQA, a novel approach that extends standard ViT backbones, originally optimized for FR, through a learnable quality token designed to predict a scalar utility score for any given face image. The learnable quality token is concatenated with the standard image patch tokens, and the whole sequence is processed via global self-attention by the ViT encoders to aggregate contextual information across all patches. At the output of the backbone, ViT-FIQA branches into two heads: (1) the patch tokens are passed through a fully connected layer to learn discriminative face representations via a margin-penalty softmax loss, and (2) the quality token is fed into a regression head to learn to predict the face sample's utility. Extensive experiments on challenging benchmarks and several FR models, including both CNN- and ViT-based architectures, demonstrate that ViT-FIQA consistently achieves top-tier performance. These results underscore the effectiveness of transformer-based architectures in modeling face image utility and highlight the potential of ViTs as a scalable foundation for future FIQA research https://cutt.ly/irHlzXUC.

人脸评估视觉变压器图像质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。