融合Mamba与Transformer,实现卫星图像中道路分割的高精度与拓扑连通性。
PathMamba: A Hybrid Mamba-Transformer for Topologically Coherent Road Segmentation in Satellite Imagery
- 用Mamba追踪道路连续性,用Transformer补充全局上下文信息。
- 在DeepGlobe和Massachusetts数据集上达到新最优,拓扑连续性提升显著。
- 兼顾高效计算与高质量输出,适合资源受限平台部署。
从卫星图像中实现高精度且拓扑连通的道路分割,对城市规划与灾害响应至关重要。现有先进方法多依赖视觉变换器(Vision Transformer),虽能捕捉全局上下文,但其二次复杂度限制了在资源受限平台上的高效部署。相比之下,状态空间模型如Mamba具有线性时间效率,天然适合建模长而连续的结构。本文提出路径感知的混合架构PathMamba,将Mamba的序列建模能力与Transformer的全局推理相结合:利用Mamba模块精准追踪道路网络的连续性,保留拓扑结构;同时引入Transformer模块以全局上下文细化特征表示。该设计在不增加计算开销的前提下,生成拓扑更优的分割结果。在DeepGlobe Road Extraction与Massachusetts Roads数据集上的实验表明,PathMamba达到新的性能上限,尤其在拓扑连续性指标APLS上显著领先,同时保持良好的计算效率。
原文摘要 · Abstract (English)
Achieving both high accuracy and topological continuity in road segmentation from satellite imagery is a critical goal for applications ranging from urban planning to disaster response. State-of-the-art methods often rely on Vision Transformers, which excel at capturing global context, yet their quadratic complexity is a significant barrier to efficient deployment, particularly for on-board processing in resource-constrained platforms. In contrast, emerging State Space Models like Mamba offer linear-time efficiency and are inherently suited to modeling long, continuous structures. We posit that these architectures have complementary strengths. To this end, we introduce PathMamba, a novel hybrid architecture that integrates Mamba's sequential modeling with the Transformer's global reasoning. Our design strategically uses Mamba blocks to trace the continuous nature of road networks, preserving topological structure, while integrating Transformer blocks to refine features with global context. This approach yields topologically superior segmentation maps without the prohibitive scaling costs of pure attention-based models. Our experiments on the DeepGlobe Road Extraction and Massachusetts Roads datasets demonstrate that PathMamba sets a new state-of-the-art. Notably, it significantly improves topological continuity, as measured by the APLS metric, setting a new benchmark while remaining computationally competitive.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。