用低秩适配+知识蒸馏,让轻量超分模型性能提升且不增加计算量。
Distillation-Supervised Convolutional Low-Rank Adaptation for Efficient Image Super-Resolution
- 在轻量网络中引入低秩卷积适配模块,仅更新少量参数。
- 在NTIRE 2025挑战赛中以最高性能夺冠,PSNR与SSIM均优于原模型。
- 适合追求高效高质图像超分的开发者和实际部署场景。
卷积神经网络广泛应用于高效图像超分辨率任务。然而,现有方法为提升性能常需加深网络或增大特征图尺寸,导致复杂度和推理成本上升。受大语言模型中LoRA成功的启发,我们提出一种新的轻量级适配方法——基于知识蒸馏的卷积低秩适配(DSCLoRA),可在不增加模型复杂度和推理开销的前提下提升性能。具体地,将ConvLoRA嵌入高效超分网络SPAN,用SConvLB模块替换SPAB模块,并在像素洗牌块及其前接卷积层中引入ConvLoRA层。该方法通过低秩分解实现参数高效更新,并采用基于空间特征相似性的知识蒸馏策略,将预训练教师模型(SPAN)的二阶统计信息迁移至学生模型。实验表明,DSCLoRA在基准数据集上显著提升PSNR与SSIM,同时保持原有效率。尤其在NTIRE 2025高效超分挑战赛的整体性能赛道中排名第一。代码与模型已开源。
原文摘要 · Abstract (English)
Convolutional neural networks (CNNs) have been widely used in efficient image super-resolution. However, for CNN-based methods, performance gains often require deeper networks and larger feature maps, which increase complexity and inference costs. Inspired by LoRA's success in fine-tuning large language models, we explore its application to lightweight models and propose Distillation-Supervised Convolutional Low-Rank Adaptation (DSCLoRA), which improves model performance without increasing architectural complexity or inference costs. Specifically, we integrate ConvLoRA into the efficient SR network SPAN by replacing the SPAB module with the proposed SConvLB module and incorporating ConvLoRA layers into both the pixel shuffle block and its preceding convolutional layer. DSCLoRA leverages low-rank decomposition for parameter updates and employs a spatial feature affinity-based knowledge distillation strategy to transfer second-order statistical information from teacher models (pre-trained SPAN) to student models (ours). This method preserves the core knowledge of lightweight models and facilitates optimal solution discovery under certain conditions. Experiments on benchmark datasets show that DSCLoRA improves PSNR and SSIM over SPAN while maintaining its efficiency and competitive image quality. Notably, DSCLoRA ranked first in the Overall Performance Track of the NTIRE 2025 Efficient Super-Resolution Challenge. Our code and models are made publicly available at https://github.com/Yaozzz666/DSCF-SR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。