轻量级网络高效分割城市遥感图像,精度接近大模型。
BAFNet: Bilateral Attention Fusion Network for Lightweight Semantic Segmentation of Urban Remote Sensing Images
- 双路径设计:捕捉长程依赖与局部细节
- 在Vaihingen和Potsdam上达83.20%和86.53% mIoU
- 参数少15倍、算力低10倍仍媲美大模型
大规模语义分割网络虽性能优异,但在样本有限、计算资源受限时应用困难。在模型规模与复杂度受限的情况下,现有方法难以有效捕捉图像中的长距离依赖并恢复细节信息。为此,本文提出一种轻量级双路径语义分割网络BAFNet,用于高效分割高分辨率城市遥感图像。该网络包含两条路径:依赖路径利用大核注意力机制获取图像长程依赖;远程-局部路径则结合多尺度局部注意力与高效远程注意力。最后通过特征融合模块整合两路径特征。在公开的高分辨率城市遥感数据集Vaihingen和Potsdam上测试,mIoU分别达到83.20%和86.53%。作为轻量级模型,BAFNet不仅优于现有先进轻量级方法,且在参数量少15倍、浮点运算量少10倍的条件下,性能可媲美非轻量级前沿方法。
原文摘要 · Abstract (English)
Large-scale semantic segmentation networks often achieve high performance, while their application can be challenging when faced with limited sample sizes and computational resources. In scenarios with restricted network size and computational complexity, models encounter significant challenges in capturing long-range dependencies and recovering detailed information in images. We propose a lightweight bilateral semantic segmentation network called bilateral attention fusion network (BAFNet) to efficiently segment high-resolution urban remote sensing images. The model consists of two paths, namely dependency path and remote-local path. The dependency path utilizes large kernel attention to acquire long-range dependencies in the image. Besides, multi-scale local attention and efficient remote attention are designed to construct remote-local path. Finally, a feature aggregation module is designed to effectively utilize the different features of the two paths. Our proposed method was tested on public high-resolution urban remote sensing datasets Vaihingen and Potsdam, with mIoU reaching 83.20% and 86.53%, respectively. As a lightweight semantic segmentation model, BAFNet not only outperforms advanced lightweight models in accuracy but also demonstrates comparable performance to non-lightweight state-of-the-art methods on two datasets, despite a tenfold variance in floating-point operations and a fifteenfold difference in network parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。