用Mamba模型实现水下图像增强,兼顾速度与效果。
Hero-Mamba: Mamba-based Dual Domain Learning for Underwater Image Enhancement

- 并行处理空间域和频域信息,分离颜色与纹理退化
- 线性复杂度捕捉长程依赖,比Transformer更高效
- 适合需要快速处理高清水下图像的科研与应用
水下图像因光线吸收和散射常出现色彩失真、对比度低、细节模糊等问题。现有基于CNN和Transformer的学习方法存在局限:CNN难以建模非均匀退化的长程依赖,Transformer则因二次计算复杂度难以应用于高分辨率图像。为此,我们提出Hero-Mamba,一种基于Mamba的新型网络,实现高效的双域学习。该方法并行处理空间域(RGB图像)与频域(FFT成分),解耦退化因素,分离颜色/亮度信息与纹理/噪声。核心采用Mamba-based SS2D模块,在线性复杂度下捕获全局感受野与长程依赖。此外,引入由背景光照先验引导的ColorFusion块,实现高保真色彩恢复。在LSUI和UIEB两个基准数据集上的实验表明,Hero-Mamba优于当前最优方法。尤其在LSUI上,达到PSNR 25.802、SSIM 0.913,验证了其优越性能与泛化能力。
原文摘要 · Abstract (English)
Underwater images often suffer from severe degradation, such as color distortion, low contrast, and blurred details, due to light absorption and scattering in water. While learning-based methods like CNNs and Transformers have shown promise, they face critical limitations: CNNs struggle to model the long-range dependencies needed for non-uniform degradation, and Transformers incur quadratic computational complexity, making them inefficient for high-resolution images. To address these challenges, we propose Hero-Mamba, a novel Mamba-based network that achieves efficient dual-domain learning for underwater image enhancement. Our approach uniquely processes information from both the spatial domain (RGB image) and the spectral domain (FFT components) in parallel. This dual-domain input allows the network to decouple degradation factors, separating color/brightness information from texture/noise. The core of our network utilizes Mamba-based SS2D blocks to capture global receptive fields and long-range dependencies with linear complexity, overcoming the limitations of both CNNs and Transformers. Furthermore, we introduce a ColorFusion block, guided by a background light prior, to restore color information with high fidelity. Extensive experiments on the LSUI and UIEB benchmark datasets demonstrate that Hero-Mamba outperforms state-of-the-art methods. Notably, our model achieves a PSNR of 25.802 and an SSIM of 0.913 on LSUI, validating its superior performance and generalization capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。