arXiv:2510.08771cs.CV2025-10

用线性注意力实现高效高质图像超分辨率,速度与质量双突破。

LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution

  • 提出全新训练稳定策略,解决线性注意力训练崩溃问题。
  • 单次前向传播即达顶尖速度,多步推理也保持高效。
  • 适合追求高速高质图像生成的开发者与研究者使用。

图像超分辨率生成模型日益强大,但其依赖自注意力的二次复杂度(O(N^2))带来严重计算瓶颈。线性注意力可实现O(N)复杂度,但其在真实感超分中的应用长期受限于一系列相互关联且未被解决的挑战。本文提出LinearSR,首个系统性克服这些难题的框架:通过基于“膝点”的早停引导微调(ESGF)策略,解决根本性的训练不稳定性;采用基于信噪比(SNR)的专家混合(MoE)架构缓解感知-失真权衡;并基于“精度优先于体积”原则构建轻量级引导范式TAG。最终模型在保持顶尖感知质量的同时,核心扩散前向过程仅需1次数值求解(1-NFE),达到当前最佳速度,多步推理时间亦具竞争力。该工作首次为真实感超分领域建立稳健的线性注意力方法,奠定了未来高效生成式超分辨率研究的基础。

原文摘要 · Abstract (English)

Generative models for Image Super-Resolution (SR) are increasingly powerful, yet their reliance on self-attention's quadratic complexity (O(N^2)) creates a major computational bottleneck. Linear Attention offers an O(N) solution, but its promise for photorealistic SR has remained largely untapped, historically hindered by a cascade of interrelated and previously unsolved challenges. This paper introduces LinearSR, a holistic framework that, for the first time, systematically overcomes these critical hurdles. Specifically, we resolve a fundamental, training instability that causes catastrophic model divergence using our novel "knee point"-based Early-Stopping Guided Fine-tuning (ESGF) strategy. Furthermore, we mitigate the classic perception-distortion trade-off with a dedicated SNR-based Mixture of Experts (MoE) architecture. Finally, we establish an effective and lightweight guidance paradigm, TAG, derived from our "precision-over-volume" principle. Our resulting LinearSR model simultaneously delivers state-of-the-art perceptual quality with exceptional efficiency. Its core diffusion forward pass (1-NFE) achieves SOTA-level speed, while its overall multi-step inference time remains highly competitive. This work provides the first robust methodology for applying Linear Attention in the photorealistic SR domain, establishing a foundational paradigm for future research in efficient generative super-resolution.

图像超分辨率线性注意力扩散模型高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。