arXiv:2411.03260cs.CV2024-11被引 2

用线性复杂度模型提升阴影去除效果,兼顾局部细节与全局连续性。

ShadowMamba: State-Space Model with Boundary-Region Selective Scan for Shadow Removal

  • 提出边界-区域选择性扫描机制,实现高效全局建模。
  • 在AISTD/ISTD/SRD数据集上超越主流方法,参数量更少、计算更快。
  • 适合需要轻量级高精度阴影去除的应用场景。

图像阴影去除是典型的低层视觉任务,阴影导致局部亮度变化,影响下游视觉任务性能。当前基于Transformer的方法因自注意力机制存在二次计算复杂度,许多方法采用局部注意力以提升效率,但限制了全局信息建模能力,削弱了区域间亮度变化感知。近期Mamba模型以线性复杂度实现强全局建模能力,但在阴影去除任务中,现有扫描策略忽略阴影边界与内部区域的语义连续性。为此,本文提出边界-区域选择性扫描机制,在保留局部细节的同时增强区域间语义连续性,有效提升阴影去除性能。此外,引入阴影掩码去噪方法以支持扫描机制并提升数据质量。基于上述技术,本文构建首个专用于阴影去除的Mamba模型——ShadowMamba。实验表明,该方法在AISTD、ISTD和SRD数据集上优于现有主流方法,同时具备显著的参数效率与计算优势。代码已开源。

原文摘要 · Abstract (English)

Image shadow removal is a typical low-level vision task. Shadows cause local brightness shifts, which reduce the performance of downstream vision tasks. Currently, Transformer-based shadow removal methods suffer from quadratic computational complexity due to the self-attention mechanism. To improve efficiency, many approaches use local attention, but this limits the ability to model global information and weakens the perception of brightness changes between regions. Recently, Mamba has shown strong performance in vision tasks by enabling global modeling with linear complexity. However, existing scanning strategies are not suitable for shadow removal, as they ignore the semantic continuity of shadow boundaries and internal regions. To address this, this paper proposes a boundary-region selective scanning mechanism that captures local details while enhancing semantic continuity between them, effectively improving shadow removal performance. In addition, a shadow mask denoising method is introduced to support the scanning mechanism and improve data quality. Based on these techniques, this paper presents a model called ShadowMamba, the first Mamba-based model designed for shadow removal. Experimental results show that the proposed method outperforms existing mainstream approaches on the AISTD, ISTD, and SRD datasets, and also offers clear advantages in parameter efficiency and computational complexity. Code is available at: https://github.com/ZHUXIUJINChris/ShadowMamba

阴影去除状态空间模型Mamba轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。