通过关系知识蒸馏,提升低分辨率图像识别准确率。
Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition
- 用三路架构实现高分辨到低分辨的知识迁移。
- 在多个任务上达到更高准确率,且模型更轻量。
- 适合需要小模型处理低质图像的场景。
尽管近年来深度模型在诸多图像识别任务中取得成功,但直接用于低分辨率图像时,因分辨率降级导致信息丢失,常出现识别准确率下降。然而,对高分辨率图像熟悉的人仍能辨识低分辨率图像。受此启发,本文提出一种教师-学生学习框架,通过混合顺序关系知识蒸馏,提升低分辨率图像识别能力。该方法包含三条路径:教师路径预训练于高分辨率图像,具备高精度识别能力;学生路径学习识别低分辨率图像,模仿教师行为;额外引入辅助路径作为桥梁,促进知识从教师到学生的传递。为保留不同层次的关系结构相似性,学生学习过程采用多种损失函数进行监督。实验表明,在度量学习、低分辨率图像分类及人脸识别任务中,该方法显著提升性能,同时保持模型紧凑。
原文摘要 · Abstract (English)
In spite of great success in many image recognition tasks achieved by recent deep models, directly applying them to recognize low-resolution images may suffer from low accuracy due to the missing of informative details during resolution degradation. However, these images are still recognizable for subjects who are familiar with the corresponding high-resolution ones. Inspired by that, we propose a teacher-student learning approach to facilitate low-resolution image recognition via hybrid order relational knowledge distillation. The approach refers to three streams: the teacher stream is pretrained to recognize high-resolution images in high accuracy, the student stream is learned to identify low-resolution images by mimicking the teacher's behaviors, and the extra assistant stream is introduced as bridge to help knowledge transfer across the teacher to the student. To extract sufficient knowledge for reducing the loss in accuracy, the learning of student is supervised with multiple losses, which preserves the similarities in various order relational structures. In this way, the capability of recovering missing details of familiar low-resolution images can be effectively enhanced, leading to a better knowledge transfer. Extensive experiments on metric learning, low-resolution image classification and low-resolution face recognition tasks show the effectiveness of our approach, while taking reduced models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。