提出BSMamba模型,通过亮度和语义建模提升低光图像增强效果。
BSMamba: Brightness and Semantic Modeling for Long-Range Interaction in Low-Light Image Enhancement
- 按亮度和语义相似性设计令牌交互,突破传统扫描限制
- 在多个数据集上达到当前最佳性能,保持图像语义一致性
- 适合需要高质量低光增强的图像修复与视觉任务
当前低光图像增强(LLIE)方法难以同时提升亮度、保持语义一致性和细节,且计算效率受限。尽管状态空间模型如Mamba在图像恢复中表现优异,但现有视觉Mamba方法将2D图像固定扫描为1D标记序列,严重限制了具有因果关系的远距离标记间的交互,难以捕捉有意义的长程依赖。为此,我们提出BSMamba,一种新型视觉Mamba架构,包含两个专门设计的组件:亮度Mamba和语义Mamba。亮度Mamba通过优先连接亮度相似的远距离标记,实现亮度引导的选择性注意力,有效解决亮度恢复难题;语义Mamba则优先连接语义相似的标记,保持图像上下文一致性,维持图像语义层次结构。通过基于亮度和语义相似性的智能标记建模,BSMamba超越传统序列化约束,同时符合因果建模原则。大量实验表明,该方法在保持语义一致性的同时实现了最先进的低光图像增强性能。代码已开源。
原文摘要 · Abstract (English)
Current low-light image enhancement (LLIE) methods face significant limitations in simultaneously improving brightness while preserving semantic consistency, fine details, and computational efficiency. With the emergence of state-space models, particularly Mamba, image restoration has achieved remarkable performance, yet existing visual Mamba approaches flatten 2D images into 1D token sequences using fixed scanning rules, critically limiting interactions between distant tokens with causal relationships and constraining their ability to capture meaningful long-range dependencies. To address these fundamental limitations, we propose BSMamba, a novel visual Mamba architecture comprising two specially designed components: Brightness Mamba and Semantic Mamba. The Brightness Mamba revolutionizes token interaction patterns by prioritizing connections between distant tokens with similar brightness levels, effectively addressing the challenge of brightness restoration in LLIE tasks through brightness-guided selective attention. Complementing this, the Semantic Mamba establishes priority interactions between tokens sharing similar semantic meanings, allowing the model to maintain contextual consistency by connecting semantically related regions across the image, thus preserving the hierarchical nature of image semantics during enhancement. By intelligently modeling tokens based on brightness and semantic similarity rather than arbitrary scanning patterns, BSMamba transcends the constraints of conventional token sequencing while adhering to the principles of causal modeling. Extensive experiments demonstrate that BSMamba achieves state-of-the-art performance in LLIE while preserving semantic consistency. Code is available at https://github.com/bywlzts/BSMamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。