arXiv:2503.00521cs.CV2025-03被引 1

用2D版Mamba提升遥感变化检测精度与效率

2DMCG:2DMambawith Change Flow Guidance for Change Detection in Remote Sensing

  • 提出2DMamba编码器,兼顾2D空间信息与线性计算复杂度
  • 在LEVIR-CD+和WHU-CD上达到新最优,准确率超现有方法1.5%以上
  • 适合追求高效高精度遥感变化检测的科研与工程人员

遥感变化检测(CD)因卷积神经网络(CNN)与变压器(Transformer)的应用取得显著进展。然而,CNN受感受野限制,而Transformer处理长序列时存在二次复杂度问题,影响可扩展性。Mamba架构因其线性复杂度和高并行性成为替代选择,但其固有的1D处理结构在2D视觉任务中会损失空间信息。本文提出一种基于视觉Mamba变体的高效框架,增强其对2D空间信息的捕捉能力,同时保持Mamba的线性复杂度。该框架采用2DMamba编码器,从多时相图像中有效学习全局空间上下文信息。特征融合阶段引入基于2D扫描的通道并行扫描策略与时空特征融合方法,精准捕捉局部与全局变化信息,缓解融合中的空间不连续问题。解码阶段提出基于特征变化流的解码方法,优化低分辨率到高分辨率特征图的变化信息映射,减少特征偏移与错位。在LEVIR-CD+和WHU-CD等基准数据集上的大量实验表明,本框架性能优于当前最先进方法,展现出视觉Mamba在高效且精确的遥感变化检测中的潜力。

原文摘要 · Abstract (English)

Remote sensing change detection (CD) has made significant advancements with the adoption of Convolutional Neural Networks (CNNs) and Transformers. While CNNs offer powerful feature extraction, they are constrained by receptive field limitations, and Transformers suffer from quadratic complexity when processing long sequences, restricting scalability. The Mamba architecture provides an appealing alternative, offering linear complexity and high parallelism. However, its inherent 1D processing structure causes a loss of spatial information in 2D vision tasks. This paper addresses this limitation by proposing an efficient framework based on a Vision Mamba variant that enhances its ability to capture 2D spatial information while maintaining the linear complexity characteristic of Mamba. The framework employs a 2DMamba encoder to effectively learn global spatial contextual information from multi-temporal images. For feature fusion, we introduce a 2D scan-based, channel-parallel scanning strategy combined with a spatio-temporal feature fusion method, which adeptly captures both local and global change information, alleviating spatial discontinuity issues during fusion. In the decoding stage, we present a feature change flow-based decoding method that improves the mapping of feature change information from low-resolution to high-resolution feature maps, mitigating feature shift and misalignment. Extensive experiments on benchmark datasets such as LEVIR-CD+ and WHU-CD demonstrate the superior performance of our framework compared to state-of-the-art methods, showcasing the potential of Vision Mamba for efficient and accurate remote sensing change detection.

遥感变化检测Mamba视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。