用状态空间模型提升低光图像亮度,兼顾效果与效率。
MambaLIE: Scene Light Intensity-Boosted Low-Light Image Enhancement with State Space Model

- 引入场景光照强度引导增强,改善光照结构分布。
- 提出双分支状态空间模型,线性复杂度建模长程依赖。
- 在多个数据集上超越主流方法,适合移动端部署。
消费级电子设备(如手机、数码相机)拍摄的图像常因传感器限制和成像管线问题出现低光退化,影响视觉质量并干扰下游视觉任务。现有基于卷积神经网络(CNN)和Transformer的方法虽能有效建模层次特征,但CNN受限于局部感受野,难以捕捉长程依赖;而Transformer虽可克服此问题,却带来巨大计算开销。为此,我们提出MambaLIE,一种基于状态空间模型(SSM)的场景光照强度增强型低光图像增强方法。首先引入场景光照强度,优化光照结构分布,并与低光输入门控融合以指导增强。为高效建模光照同时保持计算效率,提出局部增强状态空间模型(LESSM),包含SSM分支(线性时间复杂度建模长程依赖)与局部增强分支(强化局部特征表示)。大量实验表明,MambaLIE在四个广泛使用的合成基准和五个公开的真实世界基准上,均在准确率、速度和模型规模上优于当前最优的基于CNN和Transformer的LIE方法,适用于资源受限设备的实际部署。
原文摘要 · Abstract (English)
Images captured by consumer electronic devices, such as mobile phones and digital cameras, often suffer from low-light degradation due to sensor limitations and imaging pipelines, which degrades visual quality and affects downstream vision tasks. Existing methods based on Convolutional Neural Networks (CNNs) and Transformers have dominated current low-light image enhancement (LIE) due to their excellent ability to model hierarchical features. However, CNNs operate in local receptive fields that cannot model long-range dependencies, while Transformers overcome this problem but incur substantial computational costs. To address these challenges, we propose MambaLIE, a Scene Light Intensity-Boosted Low-Light Image Enhancement method based on a State Space Model (SSM). We first introduce scene light intensity to improve the structural distribution of illumination, which is then gated with the low-light input to guide enhancement. To better model the illumination while maintaining computational efficiency, we propose the Locally Enhanced State Space Model (LESSM) for efficient light enhancement. Our LESSM contains two branches: an SSM branch and a Local Enhanced branch, where the former is used to model the long-range dependencies with linear time complexity, while the latter is used to enhance local feature representations. Extensive experiments demonstrate that MambaLIE outperforms state-of-the-art CNN-based and Transformer-based LIE methods on four widely used synthetic benchmarks and five publicly available real-world benchmarks in terms of accuracy, speed, and model size, making it suitable for practical deployment on resource-constrained devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。