Mamba模型改进后,能同时捕捉遥感图像的局部细节与全局上下文。
AtrousMamaba: An Atrous-Window Scanning Visual State Space Model for Remote Sensing Change Detection
- 引入空洞窗口扫描机制,动态扩展感受野并保持局部细节
- 在6个基准数据集上超越现有CNN、Transformer和Mamba方法
- 适合需要高精度变化检测的遥感图像分析任务
近期提出的视觉状态空间(VSS)模型Mamba在长序列建模中展现出线性复杂度下的优异表现,接近Transformer效果,提升了处理视觉数据的能力。然而,多数方法通过修改Mamba的扫描机制增强全局感受野,却忽视了密集预测任务中局部信息的重要性。此外,Mamba能否像卷积神经网络(CNN)一样有效提取局部特征仍待验证。本文提出AtrousMamba,通过引入空洞窗口选择性扫描机制,实现扫描范围的可调扩张,缩短相邻标记距离,从而有效捕获细粒度局部特征与全局上下文。基于该机制,设计了面向二值变化检测(BCD)和语义变化检测(SCD)的端到端Mamba框架,分别命名为AWMambaBCD与AWMambaSCD。在六个基准数据集上的实验表明,所提框架优于现有基于CNN、Transformer和Mamba的方法。结果表明,Mamba不仅能捕捉视觉数据中的长程依赖,还能有效保留细粒度局部信息。
原文摘要 · Abstract (English)
Recently, a novel visual state space (VSS) model, referred to as Mamba, has demonstrated significant progress in modeling long sequences with linear complexity, comparable to Transformer models, thereby enhancing its adaptability for processing visual data. Although most methods aim to enhance the global receptive field by directly modifying Mamba's scanning mechanism, they tend to overlook the critical importance of local information in dense prediction tasks. Additionally, whether Mamba can effectively extract local features as convolutional neural networks (CNNs) do remains an open question that merits further investigation. In this paper, We propose a novel model, AtrousMamba, which effectively balances the extraction of fine-grained local details with the integration of global contextual information. Specifically, our method incorporates an atrous-window selective scan mechanism, enabling a gradual expansion of the scanning range with adjustable rates. This design shortens the distance between adjacent tokens, enabling the model to effectively capture fine-grained local features and global context. By leveraging the atrous window scan visual state space (AWVSS) module, we design dedicated end-to-end Mamba-based frameworks for binary change detection (BCD) and semantic change detection (SCD), referred to as AWMambaBCD and AWMambaSCD, respectively. Experimental results on six benchmark datasets show that the proposed framework outperforms existing CNN-based, Transformer-based, and Mamba-based methods. These findings clearly demonstrate that Mamba not only captures long-range dependencies in visual data but also effectively preserves fine-grained local details.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。