arXiv:2506.22246cs.CV2025-06ICCV被引 26

EAMamba提升图像修复效率,减少31%-89%计算量。

EAMamba: Efficient All-Around Vision State Space Model for Image Restoration

  • 引入多头选择性扫描模块与全向扫描策略,避免计算复杂度上升。
  • 在超分辨率、去噪、去模糊等任务中,计算量降低31%-89%。
  • 适合需要高效低级视觉处理的实时应用,如移动端图像增强。

图像修复是低层计算机视觉的关键任务,旨在从退化输入中重建高质量图像。视觉状态空间模型Vision Mamba受先进状态空间模型Mamba启发,在建模长距离依赖方面表现出色,具有线性复杂度优势。然而,其在低层视觉任务中仍面临计算复杂度随扫描序列数量增长及局部像素遗忘的问题。为此,本文提出高效全向视觉状态空间模型EAMamba,引入多头选择性扫描模块(MHSSM)和全向扫描机制。MHSSM有效聚合多个扫描序列,避免计算复杂度和参数量增加;全向扫描策略通过多种模式捕捉全局信息,解决局部像素遗忘问题。实验验证了该方法在超分辨率、去噪、去模糊和去雾等多种修复任务中的有效性。结果表明,相比现有低层Vision Mamba方法,EAMamba在保持良好性能的同时,实现了31%-89%的浮点运算量(FLOPs)降低。

原文摘要 · Abstract (English)

Image restoration is a key task in low-level computer vision that aims to reconstruct high-quality images from degraded inputs. The emergence of Vision Mamba, which draws inspiration from the advanced state space model Mamba, marks a significant advancement in this field. Vision Mamba demonstrates excellence in modeling long-range dependencies with linear complexity, a crucial advantage for image restoration tasks. Despite its strengths, Vision Mamba encounters challenges in low-level vision tasks, including computational complexity that scales with the number of scanning sequences and local pixel forgetting. To address these limitations, this study introduces Efficient All-Around Mamba (EAMamba), an enhanced framework that incorporates a Multi-Head Selective Scan Module (MHSSM) with an all-around scanning mechanism. MHSSM efficiently aggregates multiple scanning sequences, which avoids increases in computational complexity and parameter count. The all-around scanning strategy implements multiple patterns to capture holistic information and resolves the local pixel forgetting issue. Our experimental evaluations validate these innovations across several restoration tasks, including super resolution, denoising, deblurring, and dehazing. The results validate that EAMamba achieves a significant 31-89% reduction in FLOPs while maintaining favorable performance compared to existing low-level Vision Mamba methods.

图像修复状态空间模型高效算法视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。