arXiv:2507.15709cs.CV2025-07ICCV被引 3

用自训练与知识蒸馏,让人脸识别质量评估模型更轻更快。

Efficient Face Image Quality Assessment via Self-training and Knowledge Distillation

  • 先自训练强教师模型,再蒸馏出轻量学生模型。
  • 学生模型性能接近教师模型,计算开销极低。
  • 适合实时部署,已在国际竞赛中夺冠。

人脸图像质量评估(FIQA)对各类人脸应用至关重要。尽管该领域已取得显著进展,但算法的计算复杂度仍是制约其在真实系统中规模化部署的关键问题。本文提出一种高效的FIQA方法,包含两个阶段:训练一个强大的教师模型,并从中蒸馏出轻量级的学生模型。为构建强教师模型,采用自训练策略提升其能力:首先用标注数据训练教师模型,再利用其为未标注图像生成伪标签;这些伪标签样本用于两个目的:(1)向学生模型传递知识;(2)与原始标注数据结合,进一步通过自训练优化教师模型。经过增强的教师模型再为另一批未标注图像生成伪标签,用于进一步蒸馏学生模型。学生模型使用标注数据、原始教师模型和增强教师模型生成的伪标签联合训练。实验表明,学生模型在性能上接近教师模型,同时计算开销极小。此外,本方法在ICCV 2025 VQualA FIQA挑战赛中获得第一名。代码已开源:https://github.com/sunwei925/Efficient-FIQA.git。

原文摘要 · Abstract (English)

Face image quality assessment (FIQA) is essential for various face-related applications. Although FIQA has been extensively studied and achieved significant progress, the computational complexity of FIQA algorithms remains a key concern for ensuring scalability and practical deployment in real-world systems. In this paper, we aim to develop a computationally efficient FIQA method that can be easily deployed in real-world applications. Specifically, our method consists of two stages: training a powerful teacher model and distilling a lightweight student model from it. To build a strong teacher model, we adopt a self-training strategy to improve its capacity. We first train the teacher model using labeled face images, then use it to generate pseudo-labels for a set of unlabeled images. These pseudo-labeled samples are used in two ways: (1) to distill knowledge into the student model, and (2) to combine with the original labeled images to further enhance the teacher model through self-training. The enhanced teacher model is used to further pseudo-label another set of unlabeled images for distilling the student models. The student model is trained using a combination of labeled images, pseudo-labeled images from the original teacher model, and pseudo-labeled images from the enhanced teacher model. Experimental results demonstrate that our student model achieves comparable performance to the teacher model with an extremely low computational overhead. Moreover, our method achieved first place in the ICCV 2025 VQualA FIQA Challenge. The code is available at https://github.com/sunwei925/Efficient-FIQA.git.

图像质量评估知识蒸馏自训练轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。