轻量级盲超分模型,通过增强退化特征区分性提升性能
LightBSR: Towards Lightweight Blind Super-Resolution via Discriminative Implicit Degradation Representation Learning
- 用对比学习强化退化类型区分能力,提升隐式退化表示质量
- 知识蒸馏框架下学生模型仅需1.2M参数,推理速度超30fps
- 适合移动端部署,对复杂退化场景有强鲁棒性
基于隐式退化估计的盲超分辨率(IDE-BSR)依赖于从低分辨率图像中提取隐式退化表示(IDR),并将其适配到低分辨率特征以指导高分辨率细节恢复。尽管IDE-BSR在处理噪声干扰和复杂退化方面展现出潜力,但现有方法忽视了IDR的可区分性,过度复杂化适配过程,导致模型参数与计算量显著增加。本文聚焦于优化IDR的可区分性,提出一种高效轻量的盲超分模型LightBSR。具体地,采用基于知识蒸馏的学习框架:在教师阶段引入退化先验约束的对比学习,使模型更专注区分不同退化类型;在学生阶段使用特征对齐技术,将教师模型学到的退化相关知识迁移至轻量学生模型以实现高效推理。大量实验表明,基于IDR可区分性驱动的模型设计有效。所提LightBSR在多种盲超分任务中均取得优异性能,且模型复杂度极低。代码已开源:https://github.com/MJ-NCEPU/LightBSR。
原文摘要 · Abstract (English)
Implicit degradation estimation-based blind super-resolution (IDE-BSR) hinges on extracting the implicit degradation representation (IDR) of the LR image and adapting it to LR image features to guide HR detail restoration. Although IDE-BSR has shown potential in dealing with noise interference and complex degradations, existing methods ignore the importance of IDR discriminability for BSR and instead over-complicate the adaptation process to improve effect, resulting in a significant increase in the model's parameters and computations. In this paper, we focus on the discriminability optimization of IDR and propose a new powerful and lightweight BSR model termed LightBSR. Specifically, we employ a knowledge distillation-based learning framework. We first introduce a well-designed degradation-prior-constrained contrastive learning technique during teacher stage to make the model more focused on distinguishing different degradation types. Then we utilize a feature alignment technique to transfer the degradation-related knowledge acquired by the teacher to the student for practical inferencing. Extensive experiments demonstrate the effectiveness of IDR discriminability-driven BSR model design. The proposed LightBSR can achieve outstanding performance with minimal complexity across a range of blind SR tasks. Our code is accessible at: https://github.com/MJ-NCEPU/LightBSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。