提出新型图像修复网络EchoIR,提升重建质量
EchoIR: Advancing Image Restoration with Echo Upsampling and Bi-Level Optimization
- 设计双侧可学习上采样模块,减少特征退化
- 引入近似序列双层优化,统一建模修复与上采样
- 在多个数据集上超越现有方法,性能达顶尖水平
图像修复是低层视觉的核心挑战,旨在从退化图像中恢复高质量输出。随着深度学习发展,基于变换器的金字塔结构方法通过捕捉长距离跨尺度空间交互显著推进了该领域。然而,上采样过程中的关键特征损失仍严重制约修复性能。本文提出EchoIR,一种类UNet的图像修复网络,采用双侧可学习上采样机制以弥补这一缺陷。具体地,提出的Echo-Upsampler通过学习UNet中间特征的双侧信息(即“回声”),优化上采样过程,降低特征退化。为建模修复与上采样任务的层次化关系,我们进一步提出近似序列双层优化(AS-BLO)框架,建立二者间的联合学习机制。大量实验表明,EchoIR在多项主流基准上超越当前最先进方法,实现图像修复任务的领先性能。
原文摘要 · Abstract (English)
Image restoration represents a fundamental challenge in low-level vision, focusing on reconstructing high-quality images from their degraded counterparts. With the rapid advancement of deep learning technologies, transformer-based methods with pyramid structures have advanced the field by capturing long-range cross-scale spatial interaction. Despite its popularity, the degradation of essential features during the upsampling process notably compromised the restoration performance, resulting in suboptimal reconstruction outcomes. We introduce the EchoIR, an UNet-like image restoration network with a bilateral learnable upsampling mechanism to bridge this gap. Specifically, we proposed the Echo-Upsampler that optimizes the upsampling process by learning from the bilateral intermediate features of U-Net, the "Echo", aiming for a more refined restoration by minimizing the degradation during upsampling. In pursuit of modeling a hierarchical model of image restoration and upsampling tasks, we propose the Approximated Sequential Bi-level Optimization (AS-BLO), an advanced bi-level optimization model establishing a relationship between upsampling learning and image restoration tasks. Extensive experiments against the state-of-the-art (SOTA) methods demonstrate the proposed EchoIR surpasses the existing methods, achieving SOTA performance in image restoration tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。