用去遮挡蒸馏法提升口罩人脸的识别准确率。
Look Through Masks: Towards Masked Face Recognition with De-Occlusion Distillation
- 通过生成对抗网络恢复被口罩遮挡的面部内容。
- 在合成与真实数据集上识别准确率显著提升。
- 适合安防、城市管理等需要识别人脸的场景。
现实应用如视频监控和城市治理中,口罩遮挡导致人脸信息不完整、表征模糊,造成识别准确率急剧下降。受非视域感知进展启发,本文提出端到端的去遮挡蒸馏框架,包含两个模块:去遮挡模块利用生成对抗网络恢复遮挡下的面部内容,消除外观歧义;蒸馏模块以预训练通用人脸识别模型为教师,通过大量在线合成的成对数据,将教师模型中多阶实例间结构关系的知识迁移至学生模型,实现对补全后人脸的识别。该结构关系作为后验正则化,促进模型适应。实验表明,该方法在合成与真实数据集上均有效。
原文摘要 · Abstract (English)
Many real-world applications today like video surveillance and urban governance need to address the recognition of masked faces, where content replacement by diverse masks often brings in incomplete appearance and ambiguous representation, leading to a sharp drop in accuracy. Inspired by recent progress on amodal perception, we propose to migrate the mechanism of amodal completion for the task of masked face recognition with an end-to-end de-occlusion distillation framework, which consists of two modules. The \textit{de-occlusion} module applies a generative adversarial network to perform face completion, which recovers the content under the mask and eliminates appearance ambiguity. The \textit{distillation} module takes a pre-trained general face recognition model as the teacher and transfers its knowledge to train a student for completed faces using massive online synthesized face pairs. Especially, the teacher knowledge is represented with structural relations among instances in multiple orders, which serves as a posterior regularization to enable the adaptation. In this way, the knowledge can be fully distilled and transferred to identify masked faces. Experiments on synthetic and realistic datasets show the efficacy of the proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。