arXiv:2605.22351cs.CV2026-05TPAMI被引 1

2-4比特量化下实现超分辨率模型的高精度与低功耗兼顾

QuantSR+: Pushing the Limit of Quantized Image Super-Resolution Networks

论文配图:QuantSR+: Pushing the Limit of Quantized Image Super-Resolution Networks
图 1 · 摘自论文原文
  • 通过重分布比特分配、可剪枝量化架构和分块蒸馏优化训练
  • 2比特下比当前最佳方案提升0.29dB PSNR,计算量降低87.9%
  • 适用于卷积与Transformer结构,适合边缘设备部署

低比特量化广泛用于压缩超分辨率(SR)模型,以降低资源受限设备上的存储与计算开销。然而,当SR模型被压缩至超低精度(2-4比特)时,由于表征能力下降及SR任务对细节敏感,性能会显著下降。为此,本文提出QuantSR+,一个统一框架,通过改进量化算子、网络设计与训练优化,实现比以往低比特SR方法更优的精度-效率权衡。主要贡献包括:(1) 重分布驱动比特确定(RBD),在前向与反向传播中重塑量化分布以保持表征保真度;(2) 量化可剪枝架构(QSA),从过参数化模型出发,逐步剪除不关键模块以满足效率预算并提升精度;(3) 剪枝引导的功能局部蒸馏(SFD),通过直接损失与渐进式功能局部训练策略强化模块感知的特征对齐,更好捕捉量化影响并加速收敛。大量实验表明,QuantSR+在专用量化SR方法与通用量化方法中均达到顶尖性能。对于SwinIR-S在Urban100(x4)上,相比2比特最先进基线提升0.29 dB PSNR。同时在2比特下实现显著效率优势,计算量最多减少87.9%,存储减少89.4%。该方法对卷积与Transformer-based SR模型均有效,具有广泛适用性。

原文摘要 · Abstract (English)

Low-bit quantization is widely used to compress super-resolution (SR) models and reduce storage and computation costs for deployment on resource-limited devices. However, when SR models are pushed to ultra-low precision (2-4 bits), performance can drop sharply due to diminished representational capacity and the detail-sensitive nature of SR. To address these issues, we propose QuantSR+, a unified framework that improves quantization operators, network design, and training optimization, achieving better trade-offs between accuracy and efficiency than prior low-bit SR methods. QuantSR+ mainly relies on three technical contributions: (1) Redistribution-driven Bit Determination (RBD), which reshapes quantization distributions in both forward and backward passes to preserve representation fidelity; (2) Quantized Slimmable Architecture (QSA), which begins with an over-parameterized model and progressively prunes less critical blocks to meet efficiency budgets while pushing the accuracy performance; and (3) Slimming-guided Function-localized Distillation (SFD), which enforces block-aware feature alignment via a direct loss and a progressive, function-local training schedule to capture quantization effects better and speed up convergence. Extensive experiments show that QuantSR+ achieves state-of-the-art performance against both specialized quantized SR methods and generic quantization approaches. For SwinIR-S on Urban100 (x4), it improves PSNR by 0.29 dB over the 2-bit SOTA baseline. Meanwhile, it delivers strong efficiency gains at 2-bit, reducing operations by up to 87.9% and storage by 89.4%. QuantSR+ is effective for both convolutional and transformer-based SR models, indicating broad applicability.

超分辨率量化边缘计算模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。