arXiv:2412.11779cs.CV2024-12中稿 · EAI ROSENET 2024 -…被引 4

研究对齐如何影响人脸图像质量评分,发现其在真实场景下影响更大。

Impact of Face Alignment on Face Image Quality

  • 用MTCNN和RetinaFace进行人脸检测与对齐,评估不同质量指标
  • 发现对齐会显著改变图像质量评分,尤其在复杂环境下更明显
  • 提醒开发者在质量评估中必须考虑对齐步骤的影响

人脸对齐是面部分析任务中特征提取的关键预处理步骤。在人脸识别、表情识别和属性分类等应用中,对齐常用于训练和推理阶段以标准化面部关键点位置。尽管对齐方法显著影响模型性能,但其对图像质量的影响尚未被充分研究。现有面部图像质量评估(FIQA)研究通常默认对齐为前提,却未明确评估对齐本身如何影响质量指标,尤其在基于深度学习的检测器融合检测与关键点定位的背景下。为此,本研究系统考察了对齐对图像质量评分的影响。实验在LFW、IJB-B和SCFace数据集上进行,采用MTCNN和RetinaFace进行检测与对齐,并使用SER-FIQ、FaceQAN、DifFIQA和SDD-FIQA等方法评估质量。分析包括对LFW和IJB-B的数据分布,以及SCFace数据集中不同距离下的平均质量得分。结果表明,质量评估方法对对齐高度敏感,且在复杂真实条件下敏感性进一步增强,凸显了在质量评估中纳入对齐影响的重要性。

原文摘要 · Abstract (English)

Face alignment is a crucial step in preparing face images for feature extraction in facial analysis tasks. For applications such as face recognition, facial expression recognition, and facial attribute classification, alignment is widely utilized during both training and inference to standardize the positions of key landmarks in the face. It is well known that the application and method of face alignment significantly affect the performance of facial analysis models. However, the impact of alignment on face image quality has not been thoroughly investigated. Current FIQA studies often assume alignment as a prerequisite but do not explicitly evaluate how alignment affects quality metrics, especially with the advent of modern deep learning-based detectors that integrate detection and landmark localization. To address this need, our study examines the impact of face alignment on face image quality scores. We conducted experiments on the LFW, IJB-B, and SCFace datasets, employing MTCNN and RetinaFace models for face detection and alignment. To evaluate face image quality, we utilized several assessment methods, including SER-FIQ, FaceQAN, DifFIQA, and SDD-FIQA. Our analysis included examining quality score distributions for the LFW and IJB-B datasets and analyzing average quality scores at varying distances in the SCFace dataset. Our findings reveal that face image quality assessment methods are sensitive to alignment. Moreover, this sensitivity increases under challenging real-life conditions, highlighting the importance of evaluating alignment's role in quality assessment.

人脸对齐图像质量深度学习面部分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。