arXiv:2509.20918cs.CV2025-09被引 2

融合局部与全局感知的Mamba模型,提升遥感图像语义分割精度

SwinMamba: A hybrid local-global mamba framework for enhancing semantic segmentation of remotely sensed images

  • 分阶段设计:前两阶段局部扫描捕捉细节,后两阶段全局扫描融合上下文
  • 在LoveDA和Potsdam数据集上优于现有方法,显著提升分割准确率
  • 适合需要高精度遥感图像分析的研究者与应用开发者

遥感图像语义分割是计算机视觉中的基础任务,广泛应用于土地利用分类、城市规划和环境监测。然而,高分辨率、复杂场景结构及多尺度目标使该任务面临挑战。为应对这些问题,本文提出SwinMamba框架,受Swin Transformer启发,将局部Mamba扫描与重叠移位窗口结合,同时保留全局感受野。前两个阶段采用局部扫描以捕获纹理、边缘等细粒度特征,后两个阶段通过全局扫描融合整体上下文信息。重叠移位窗口增强区域间特征交互,提升全局特征整合能力。在LoveDA与ISPRS Potsdam数据集上的大量实验表明,SwinMamba性能超越当前先进方法,验证了其在遥感图像语义分割中的有效性与潜力。

原文摘要 · Abstract (English)

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often challenged by the high spatial resolution, complex scene structures, and diverse object scales present in remote sensing data. To address these challenges, various deep learning architectures have been proposed, including convolutional neural networks, Vision Transformers, and the recently introduced Vision Mamba. Vision Mamba features a global receptive field and low computational complexity, demonstrating both efficiency and effectiveness in image segmentation. However, its reliance on global scanning tends to overlook critical local features, such as textures and edges, which are essential for achieving accurate segmentation in remote sensing contexts. To tackle this limitation, we propose SwinMamba, a novel framework inspired by the Swin Transformer. SwinMamba integrates localized Mamba-style scanning within shifted windows with a global receptive field, to enhance the model's perception of both local and global features. Specifically, the first two stages of SwinMamba perform local scanning to capture fine-grained details, while its subsequent two stages leverage global scanning to fuse broader contextual information. In our model, the use of overlapping shifted windows enhances inter-region information exchange, facilitating more robust feature integration across the entire image. Extensive experiments on the LoveDA and ISPRS Potsdam datasets demonstrate that SwinMamba outperforms state-of-the-art methods, underscoring its effectiveness and potential as a superior solution for semantic segmentation of remotely sensed imagery.

遥感分割Mamba局部全局图像分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。