无需训练即可高效评估人脸图像质量,提升人脸识别可靠性。
FROQ: Observing Face Recognition Models for Efficient Quality Assessment
- 利用预训练人脸识别模型的中间特征,不需额外训练
- 在8个数据集上表现媲美顶尖方法,速度显著更快
- 适合部署在资源受限场景,无需重新训练模型
人脸识别在诸多高风险应用中至关重要,错误识别可能带来严重后果。人脸图像质量评估(FIQA)通过估计图像质量,帮助系统剔除不适配或低置信度的样本。现有主流FIQA方法依赖大量有监督训练,而无监督方法虽免于训练但速度慢、性能差。本文提出FROQ(Face Recognition Observer of Quality),一种半监督、无需训练的方法,利用现有FR模型的中间表示进行质量评估,兼具监督方法的高精度与无监督方法的高效性。通过基于伪标签的简单校准步骤,FROQ可从任意现代FR模型中挖掘出有效质量表征。伪标签由一种基于样本扰动的新无监督FIQA方法生成。在四个先进FR模型和八个基准数据集上的实验表明,FROQ在性能与运行效率上均达到顶尖水平,且无需显式训练。
原文摘要 · Abstract (English)
Face Recognition (FR) plays a crucial role in many critical (high-stakes) applications, where errors in the recognition process can lead to serious consequences. Face Image Quality Assessment (FIQA) techniques enhance FR systems by providing quality estimates of face samples, enabling the systems to discard samples that are unsuitable for reliable recognition or lead to low-confidence recognition decisions. Most state-of-the-art FIQA techniques rely on extensive supervised training to achieve accurate quality estimation. In contrast, unsupervised techniques eliminate the need for additional training but tend to be slower and typically exhibit lower performance. In this paper, we introduce FROQ (Face Recognition Observer of Quality), a semi-supervised, training-free approach that leverages specific intermediate representations within a given FR model to estimate face-image quality, and combines the efficiency of supervised FIQA models with the training-free approach of unsupervised methods. A simple calibration step based on pseudo-quality labels allows FROQ to uncover specific representations, useful for quality assessment, in any modern FR model. To generate these pseudo-labels, we propose a novel unsupervised FIQA technique based on sample perturbations. Comprehensive experiments with four state-of-the-art FR models and eight benchmark datasets show that FROQ leads to highly competitive results compared to the state-of-the-art, achieving both strong performance and efficient runtime, without requiring explicit training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。