通过关系对比蒸馏,提升低分辨率图像的物体识别能力。
Low-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation
- 用跨分辨率关系对比损失,让学生模型学习教师模型的特征结构
- 在低分辨率分类和人脸识别任务中准确率显著提升
- 适合处理训练与测试图像差异大的低分辨率识别场景
低分辨率图像中的物体识别因缺乏细节信息而极具挑战。尽管已有研究通过知识蒸馏将高分辨率教师模型的知识迁移到低分辨率学生模型,但在训练与测试图像存在显著表征差异时仍表现不佳。本文提出一种跨分辨率关系对比蒸馏方法,使学生模型能够模仿在高分辨率图像上表现优异的教师模型。通过对比表示空间中的关系结构保持损失,监督学生模型学习,有效增强对熟悉低分辨率物体缺失细节的恢复能力,从而实现更优的知识迁移。在低分辨率物体分类与低分辨率人脸识别任务上的大量实验验证了该方法的有效性与适应性。
原文摘要 · Abstract (English)
Recognizing objects in low-resolution images is a challenging task due to the lack of informative details. Recent studies have shown that knowledge distillation approaches can effectively transfer knowledge from a high-resolution teacher model to a low-resolution student model by aligning cross-resolution representations. However, these approaches still face limitations in adapting to the situation where the recognized objects exhibit significant representation discrepancies between training and testing images. In this study, we propose a cross-resolution relational contrastive distillation approach to facilitate low-resolution object recognition. Our approach enables the student model to mimic the behavior of a well-trained teacher model which delivers high accuracy in identifying high-resolution objects. To extract sufficient knowledge, the student learning is supervised with contrastive relational distillation loss, which preserves the similarities in various relational structures in contrastive representation space. In this manner, the capability of recovering missing details of familiar low-resolution objects can be effectively enhanced, leading to a better knowledge transfer. Extensive experiments on low-resolution object classification and low-resolution face recognition clearly demonstrate the effectiveness and adaptability of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。