arXiv:2605.23451cs.CV2026-05被引 1

提出轻量级图像超分辨率模型,实现快速高清修复。

Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention

论文配图:Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention
图 1 · 摘自论文原文
  • 用32倍压缩减少冗余特征,构建紧凑潜在表示
  • 采用线性注意力机制,恢复速度达0.019秒/图
  • 适合移动端部署,参数仅344M,计算量低

真实世界图像超分辨率旨在从复杂未知退化中恢复高质量图像。现有生成式方法沿用高分辨率图像合成中的密集潜在表示与二次复杂度全局建模范式,导致计算开销、内存占用和推理延迟随分辨率增长而急剧上升,限制了实际应用。本文认为瓶颈不在于修复先验不足,而在于高分辨率恢复中存在过度的令牌冗余与高昂的令牌交互成本。基于此,我们从紧凑潜在表示与线性复杂度建模出发,提出SANA-SR高效单步恢复框架。该模型采用32倍压缩比的深度压缩自编码器,大幅减少潜在令牌数,同时保留关键结构与纹理信息;在此紧凑空间上,引入使用LoRA微调的线性注意力DiT,实现线性复杂度的令牌融合。在所有基准数据集上的实验表明,SANA-SR在定量指标上表现优异,且修复图像纹理更清晰、更真实。模型剪枝后可在0.019秒内完成推理,仅需407.95G MACs和344M参数,具备强大移动端部署潜力。

原文摘要 · Abstract (English)

Real-world image super-resolution aims to recover high-quality images from complex and unknown real-world degradations. However, existing generative Real-ISR methods largely inherit the dense latent representations and quadratic-cost global modeling paradigm developed for high-resolution image synthesis, causing computation, memory usage, and inference latency to scale unfavorably with resolution and thus limiting practical deployment. We argue that the key bottleneck lies not in insufficient restoration priors, but in excessive token redundancy and costly token interactions during high-resolution restoration. Motivated by this observation, we revisit Real-ISR from the perspectives of compact latent representation and linear-complexity modeling, and propose SANA-SR, an efficient one-step restoration framework. Specifically, SANA-SR employs a deep compression autoencoder with a 32x compression ratio to drastically reduce latent tokens while preserving restoration-relevant structures and textures. On top of this compact latent space, we introduce a linear-attention DiT with LoRA fine-tuning, enabling efficient high-resolution restoration with linear-complexity token mixing. Extensive experiments on all benchmark datasets demonstrate that SANA-SR achieves highly competitive and often superior quantitative performance against existing methods, while restoring clearer and more realistic textures. Moreover, after pruning, the deployed model runs in 0.019s with 407.95G MACs and 344M parameters, highlighting its strong potential for practical mobile deployment.

图像修复扩散模型轻量化移动端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。