用生成与判别双路径蒸馏,提升超低分辨率人脸识别准确率
Distilling Generative-Discriminative Representations for Very Low-Resolution Face Recognition
- 用预训练扩散模型做生成教师,指导学生主干学习细节特征
- 引入跨分辨率关系对比蒸馏,提升学生头部的判别能力
- 适合低分辨率人脸识别场景,尤其对模糊或小图效果显著
超低分辨率人脸识别因分辨率退化导致面部细节严重丢失而极具挑战。本文提出一种生成-判别表征蒸馏方法,结合生成表征与跨分辨率对齐知识蒸馏,通过两个蒸馏模块联合优化学生模型。首先,以预训练人脸超分扩散模型的编码器作为生成教师,通过特征回归监督学生主干学习,随后冻结主干;接着,以预训练人脸识别模型为判别教师,通过跨分辨率关系对比蒸馏,指导学生头部学习判别性表征。该方法使通用主干表征转化为判别性头部表征,构建出鲁棒且具有判别力的学生模型,有效恢复超低分辨率人脸缺失细节,实现更优的知识迁移。大量实验在多个数据集上验证了本方法在超低分辨率人脸识别中的有效性与适应性。
原文摘要 · Abstract (English)
Very low-resolution face recognition is challenging due to the serious loss of informative facial details in resolution degradation. In this paper, we propose a generative-discriminative representation distillation approach that combines generative representation with cross-resolution aligned knowledge distillation. This approach facilitates very low-resolution face recognition by jointly distilling generative and discriminative models via two distillation modules. Firstly, the generative representation distillation takes the encoder of a diffusion model pretrained for face super-resolution as the generative teacher to supervise the learning of the student backbone via feature regression, and then freezes the student backbone. After that, the discriminative representation distillation further considers a pretrained face recognizer as the discriminative teacher to supervise the learning of the student head via cross-resolution relational contrastive distillation. In this way, the general backbone representation can be transformed into discriminative head representation, leading to a robust and discriminative student model for very low-resolution face recognition. Our approach improves the recovery of the missing details in very low-resolution faces and achieves better knowledge transfer. Extensive experiments on face datasets demonstrate that our approach enhances the recognition accuracy of very low-resolution faces, showcasing its effectiveness and adaptability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。