arXiv:2412.07222cs.CVcs.AI2024-12被引 1

用Mamba建模像素级长序列交互,提升图像超分辨率效果

MPSI: Mamba enhancement model for pixel-wise sequential interaction Image Super-Resolution

  • 引入通道级Mamba模块捕捉长程像素交互
  • 提出递归通道模块保留早期特征,增强多层信息融合
  • 在多个数据集上达到最新超分辨率性能

单图像超分辨率(SR)是计算机视觉中的长期挑战。尽管深度学习催生了众多方法,现有技术在建模长序列信息方面仍存在不足,难以有效捕捉全局像素交互。为此,本文提出马尔可夫像素级序列交互网络(MPSI),旨在增强长距离信息连接,特别关注像素级序列交互。设计通道级Mamba块(CMB),通过有效建模长序列信息来捕获全面的像素交互特征。此外,现有方法常忽略前层提取的特征,导致有价值信息丢失;虽有模型尝试保留这些特征,但跨层连接建立困难。MPSI引入马尔可夫通道递归模块(MCRM),最大化保留早期层的有用特征信息,促进多层次像素序列交互信息获取。大量实验表明,MPSI在图像重建质量上优于现有方法,达到当前最优性能。

原文摘要 · Abstract (English)

Single image super-resolution (SR) has long posed a challenge in the field of computer vision. While the advent of deep learning has led to the emergence of numerous methods aimed at tackling this persistent issue, the current methodologies still encounter challenges in modeling long sequence information, leading to limitations in effectively capturing the global pixel interactions. To tackle this challenge and achieve superior SR outcomes, we propose the Mamba pixel-wise sequential interaction network (MPSI), aimed at enhancing the establishment of long-range connections of information, particularly focusing on pixel-wise sequential interaction. We propose the Channel-Mamba Block (CMB) to capture comprehensive pixel interaction information by effectively modeling long sequence information. Moreover, in the existing SR methodologies, there persists the issue of the neglect of features extracted by preceding layers, leading to the loss of valuable feature information. While certain existing models strive to preserve these features, they frequently encounter difficulty in establishing connections across all layers. To overcome this limitation, MPSI introduces the Mamba channel recursion module (MCRM), which maximizes the retention of valuable feature information from early layers, thereby facilitating the acquisition of pixel sequence interaction information from multiple-level layers. Through extensive experimentation, we demonstrate that MPSI outperforms existing super-resolution methods in terms of image reconstruction results, attaining state-of-the-art performance.

图像超分Mamba像素交互特征保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。