arXiv:2608.30782cs.CV2026-08

将图像修复与感知细节生成分离,实现高效真实世界超分辨率。

PixelIR: Fidelity-Perception Decoupling via Pixel-Space Image-Residual Flow Matching for Efficient One-Step Real-World Super-Resolution

论文配图:PixelIR: Fidelity-Perception Decoupling via Pixel-Space Image-Residual Flow Matching for Efficient One-Step Real-World Super-Resolution
图 1 · 摘自论文原文
  • 在像素空间通过残差流匹配,分两步完成保真重建与细节生成。
  • 单次推理仅需8.5ms,参数量32.9M,PSNR、SSIM、LPIPS全面领先。
  • 适合追求高效率与高质量图像恢复的工业级应用部署。

真实世界图像超分辨率(Real-ISR)旨在保留退化观测中的结构信息,同时重建具有感知真实感的细节。然而,现有方法大多在共享网络中联合优化保真度与感知质量,导致两者在训练过程中相互干扰,难以控制平衡。近期的一步法方法虽减少了采样步骤,但仍继承了这种耦合优化行为,并沿用多步方法的高分辨率主干网络,计算开销大。本文认为,高效的Real-ISR不仅需要更短的采样轨迹,还需对保真重建与感知细节合成进行专门建模。为此,提出PixelIR,一种基于像素空间图像残差流匹配的保真-感知解耦框架。PixelIR首先学习从退化图像到保真重建的图像流;随后,通过残差流从噪声中合成缺失的感知细节,无需重复学习或覆盖完整恢复结果。进一步在粗到细金字塔架构中,将教师模型蒸馏为面向部署的一步式学生模型。大量实验表明,PixelIR在RealSR和DRealSR数据集上均达到领先的PSNR、SSIM和LPIPS指标。最终模型在单次评估中完成像素空间恢复,仅需32.9M参数、89.7G MACs和8.5ms延迟,展现出强大的保真-感知-效率平衡能力。

原文摘要 · Abstract (English)

Real-world image super-resolution (Real-ISR) aims to preserve structures supported by the degraded observation while reconstructing perceptually realistic details. However, existing Real-ISR methods largely optimize fidelity and perceptual quality within a shared network, causing the two objectives to interfere throughout training and making their balance difficult to control. Recent one-step methods reduce sampling steps, yet often inherit both this coupled optimization behavior and the expensive high-resolution backbone of their multi-step predecessors. We argue that efficient Real-ISR requires not only a shorter sampling trajectory, but also specialized modeling of faithful reconstruction and perceptual detail synthesis. Based on this insight, we propose PixelIR, a fidelity-perception decoupling framework built upon pixel-space image-residual flow matching. PixelIR first learns an image flow that maps the degraded observation to a faithful reconstruction. Then, a residual flow synthesizes the missing perceptual details from noise without repeatedly relearning or overwriting the complete restoration solution. We further distill the teacher into a deployment-oriented one-step student within a coarse-to-fine pyramid architecture. Extensive experiments show that PixelIR achieves leading PSNR, SSIM, and LPIPS on both RealSR and DRealSR. The final model completes pixel-space restoration in a single evaluation with only 32.9M parameters, 89.7G MACs, and 8.5ms latency, demonstrating a strong practical fidelity-perception-efficiency balance.

超分辨率扩散模型效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。