TinySR通过精简扩散模型,实现快速真实图像超分辨率。
TinySR: Pruning Diffusion for Real-World Image Super-Resolution
- 设计动态块激活与扩缩策略,高效剪枝深层网络
- 比教师模型快5.68倍,参数减少83%,保持高质量输出
- 适合移动端或实时应用的轻量级图像修复
真实世界图像超分辨率(Real-ISR)旨在从受复杂退化(如噪声、模糊、压缩)影响的低分辨率图像中恢复高质量图像。近年来,扩散模型凭借强大的生成先验在该领域展现潜力,但其迭代去噪过程计算开销大,难以满足实时需求。尽管单步蒸馏方法(如OSEDiff和TSD-SR)提升了推理速度,仍受限于庞大且过参数化的模型架构。本文提出TinySR,一种专为Real-ISR设计的紧凑高效扩散模型,实现实时性能并保持感知质量。通过引入动态块间激活机制与扩展-腐蚀剪枝策略,提升深度剪枝效果;采用通道剪枝、注意力模块移除和轻量级分组卷积实现VAE压缩;移除时间与提示相关模块,并采用预缓存技术进一步加速。相较教师模型TSD-SR,TinySR计算成本显著降低,最高提速5.68倍,参数量减少83%,同时保持高保真度结果。
原文摘要 · Abstract (English)
Real-world image super-resolution (Real-ISR) focuses on recovering high-quality images from low-resolution inputs that suffer from complex degradations like noise, blur, and compression. Recently, diffusion models (DMs) have shown great potential in this area by leveraging strong generative priors to restore fine details. However, their iterative denoising process incurs high computational overhead, posing challenges for real-time applications. Although one-step distillation methods, such as OSEDiff and TSD-SR, offer faster inference, they remain fundamentally constrained by their large, over-parameterized model architectures. In this work, we present TinySR, a compact yet effective diffusion model specifically designed for Real-ISR that achieves real-time performance while maintaining perceptual quality. We introduce a Dynamic Inter-block Activation and an Expansion-Corrosion Strategy to facilitate more effective decision-making in depth pruning. We achieve VAE compression through channel pruning, attention removal and lightweight SepConv. We eliminate time- and prompt-related modules and perform pre-caching techniques to further speed up the model. TinySR significantly reduces computational cost and model size, achieving up to 5.68x speedup and 83% parameter reduction compared to its teacher TSD-SR, while still providing high quality results.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。