用轻量适配让老模型快速学会真实超分,又快又准。
AdaptSR: Low-Rank Adaptation for Efficient and Scalable Real-World Super-Resolution
- 只更新低秩适配层,不碰预训练主干,节省资源。
- 实测比生成式方法高4dB PSNR,感知评分高2%。
- 训练参数少92%,几分钟内完成真实场景适配。
从低分辨率图像恢复高频细节与纹理仍是超分辨率的核心挑战,尤其在真实世界退化复杂且未知的情况下。尽管基于GAN的方法提升真实感,但存在训练不稳定和引入不自然伪影的问题;扩散模型虽有潜力,却需大量计算资源,单步变体常需数个GPU天。我们提出AdaptSR,一种基于低秩适配(LoRA)的框架,可高效复用双三次预训练的超分模型,实现对真实退化的适应。AdaptSR结合架构特性与选择性层更新策略,在保持预训练主干不变的前提下,仅更新轻量级LoRA层,捕获领域特异性调整,且推理时无额外开销,适配层可无缝融合。该方法显著降低内存与计算需求,使真实超分可在轻量硬件上实现。实验表明,AdaptSR在真实超分基准上相比GAN与扩散模型方法,最高提升4 dB PSNR与2%感知分数;更令人印象深刻的是,其性能媲美甚至超越全模型微调,同时仅需训练92%更少的参数,可在分钟级完成真实任务适配。
原文摘要 · Abstract (English)
Recovering high-frequency details and textures from low-resolution images remains a fundamental challenge in super-resolution (SR), especially when real-world degradations are complex and unknown. While GAN-based methods enhance realism, they suffer from training instability and introduce unnatural artifacts. Diffusion models, though promising, demand excessive computational resources, often requiring multiple GPU days, even for single-step variants. Rather than naively fine-tuning entire models or adopting unstable generative approaches, we introduce AdaptSR, a low-rank adaptation (LoRA) framework that efficiently repurposes bicubic-trained SR models for real-world tasks. AdaptSR leverages architecture-specific insights and selective layer updates to optimize real SR adaptation. By updating only lightweight LoRA layers while keeping the pretrained backbone intact, it captures domain-specific adjustments without adding inference cost, as the adapted layers merge seamlessly post-training. This efficient adaptation not only reduces memory and compute requirements but also makes real-world SR feasible on lightweight hardware. Our experiments demonstrate that AdaptSR outperforms GAN and diffusion-based SR methods by up to 4 dB in PSNR and 2% in perceptual scores on real SR benchmarks. More impressively, it matches or exceeds full model fine-tuning while training 92% fewer parameters, enabling rapid adaptation to real SR tasks within minutes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。