用双分支Transformer提升遥感图像道路提取精度,尤其擅长处理遮挡路段。
DB SwinT: A Dual-Branch Swin Transformer Network for Road Extraction in Optical Remote Sensing Imagery
- 双分支结构分别捕捉局部细节和全局语义,增强对遮挡道路的识别能力。
- 在Massachusetts和DeepGlobe数据集上分别达到79.35%和74.84%的交并比。
- 适合城市规划、灾情监测等需要高精度道路信息的应用场景。
随着光学遥感影像空间分辨率持续提升,道路提取在城市规划、交通监控和灾害管理等应用中变得日益重要。然而,在复杂城乡环境中,道路常被树木、建筑等遮挡,导致结构断裂、提取精度下降。为此,本文提出一种双分支Swin Transformer网络(DB SwinT)用于道路提取。该框架结合Swin Transformer的长程依赖建模能力与U-Net的多尺度特征融合策略,并采用双分支编码器学习互补的局部与全局表征:局部分支聚焦恢复遮挡区域的细粒度结构,全局分支捕捉更广泛的语义上下文以保持道路网络的整体连贯性。此外,引入注意力特征融合(AFF)模块,自适应融合双分支特征,进一步提升遮挡路段的表示能力。在Massachusetts和DeepGlobe数据集上的实验结果表明,DB SwinT分别取得79.35%和74.84%的交并比(IoU),验证了其在光学遥感图像道路提取中的有效性。
原文摘要 · Abstract (English)
With the continuous improvement in the spatial resolution of optical remote sensing imagery, accurate road extraction has become increasingly important for applications such as urban planning, traffic monitoring, and disaster management. However, road extraction in complex urban and rural environments remains challenging, as roads are often occluded by trees, buildings, and other objects, leading to fragmented structures and reduced extraction accuracy. To address this problem, this paper proposes a Dual-Branch Swin Transformer network (DB SwinT) for road extraction. The proposed framework combines the long-range dependency modeling capability of the Swin Transformer with the multi-scale feature fusion strategy of U-Net, and employs a dual-branch encoder to learn complementary local and global representations. Specifically, the local branch focuses on recovering fine structural details in occluded areas, while the global branch captures broader semantic context to preserve the overall continuity of road networks. In addition, an Attentional Feature Fusion (AFF) module is introduced to adaptively fuse features from the two branches, further enhancing the representation of occluded road segments. Experimental results on the Massachusetts and DeepGlobe datasets show that DB SwinT achieves Intersection over Union (IoU) scores of 79.35\% and 74.84\%, respectively, demonstrating its effectiveness for road extraction from optical remote sensing imagery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。