Mamba模型解决遥感图像处理中计算量大与视野局限问题,提升高分辨率数据处理效率。
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook
- 采用状态空间模型(SSM)实现线性计算复杂度,突破传统CNN与ViT瓶颈
- 系统梳理120篇相关研究,构建从架构到应用的完整分类体系
- 适合关注遥感智能分析、高效模型设计的研究者与工程团队
深度学习深刻改变了遥感领域,但主流架构如卷积神经网络(CNN)受限于感受野有限,视觉变压器(ViTs)则面临二次计算复杂度问题,难以扩展至高分辨率遥感数据。状态空间模型(SSMs),尤其是近期提出的Mamba架构,成为颠覆性解决方案,兼具线性计算复杂度与全局上下文建模能力。本综述全面回顾了遥感领域基于Mamba的方法,系统分析约120篇相关研究,构建了创新与应用的综合分类体系。贡献涵盖五个维度:(i) 视觉Mamba架构基础原理;(ii) 自适应扫描策略与混合SSM等微架构改进;(iii) CNN-Transformer-Mamba融合及频域适配等宏观架构集成;(iv) 在目标检测、语义分割、变化检测等多项任务中与先进方法的严格基准对比;(v) 对未解决问题的批判性分析与可操作的未来方向。本综述弥合了SSM理论与遥感实践之间的差距,确立Mamba为遥感分析的变革性框架。据我们所知,这是首篇系统性综述遥感中Mamba架构的论文。我们建立开源仓库(https://github.com/BaoBao0926/Awesome-Mamba-in-Remote-Sensing),推动社区持续发展。
原文摘要 · Abstract (English)
Deep learning has profoundly transformed remote sensing, yet prevailing architectures like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) remain constrained by critical trade-offs: CNNs suffer from limited receptive fields, while ViTs grapple with quadratic computational complexity, hindering their scalability for high-resolution remote sensing data. State Space Models (SSMs), particularly the recently proposed Mamba architecture, have emerged as a paradigm-shifting solution, combining linear computational scaling with global context modeling. This survey presents a comprehensive review of Mamba-based methodologies in remote sensing, systematically analyzing about 120 Mamba-based remote sensing studies to construct a holistic taxonomy of innovations and applications. Our contributions are structured across five dimensions: (i) foundational principles of vision Mamba architectures, (ii) micro-architectural advancements such as adaptive scan strategies and hybrid SSM formulations, (iii) macro-architectural integrations, including CNN-Transformer-Mamba hybrids and frequency-domain adaptations, (iv) rigorous benchmarking against state-of-the-art methods in multiple application tasks, such as object detection, semantic segmentation, change detection, etc. and (v) critical analysis of unresolved challenges with actionable future directions. By bridging the gap between SSM theory and remote sensing practice, this survey establishes Mamba as a transformative framework for remote sensing analysis. To our knowledge, this paper is the first systematic review of Mamba architectures in remote sensing. Our work provides a structured foundation for advancing research in remote sensing systems through SSM-based methods. We curate an open-source repository (https://github.com/BaoBao0926/Awesome-Mamba-in-Remote-Sensing) to foster community-driven advancements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。