通过不确定性建模融合全局与局部特征,提升遥感影像建筑提取精度
UAGLNet: Uncertainty-Aggregated Global-Local Fusion Network with Cooperative CNN-Transformer for Building Extraction
- 采用混合CNN与Transformer结构协同捕捉局部与全局语义
- 在深层网络中引入交互块,缩小特征金字塔的局部-全局差距
- 基于像素级不确定性估计,显著减少模糊区域的分割歧义
由于建筑结构复杂多变,遥感图像中的建筑提取仍具挑战性。现有方法依赖卷积或自注意力模块捕捉多尺度特征,但特征金字塔固有的局部-全局差异以及融合不足导致结果不准确、模糊。为此,本文提出不确定性聚合的全局-局部融合网络(UAGLNet),在不确定性建模引导下有效利用高质量的全局-局部视觉语义。具体而言,设计一种混合编码器,在不同阶段分别采用卷积和变换器层以捕获局部与全局语义;引入中间协同交互块(CIB),缓解深层网络中局部与全局特征的差距;提出全局-局部融合(GLF)模块,互补融合两类表征;为减轻不确定区域的分割歧义,设计不确定性聚合解码器(UAD),显式估计像素级不确定性以提升分割精度。大量实验表明,本方法优于现有先进模型。代码已开源:https://github.com/Dstate/UAGLNet
原文摘要 · Abstract (English)
Building extraction from remote sensing images is a challenging task due to the complex structure variations of the buildings. Existing methods employ convolutional or self-attention blocks to capture the multi-scale features in the segmentation models, while the inherent gap of the feature pyramids and insufficient global-local feature integration leads to inaccurate, ambiguous extraction results. To address this issue, in this paper, we present an Uncertainty-Aggregated Global-Local Fusion Network (UAGLNet), which is capable to exploit high-quality global-local visual semantics under the guidance of uncertainty modeling. Specifically, we propose a novel cooperative encoder, which adopts hybrid CNN and transformer layers at different stages to capture the local and global visual semantics, respectively. An intermediate cooperative interaction block (CIB) is designed to narrow the gap between the local and global features when the network becomes deeper. Afterwards, we propose a Global-Local Fusion (GLF) module to complementarily fuse the global and local representations. Moreover, to mitigate the segmentation ambiguity in uncertain regions, we propose an Uncertainty-Aggregated Decoder (UAD) to explicitly estimate the pixel-wise uncertainty to enhance the segmentation accuracy. Extensive experiments demonstrate that our method achieves superior performance to other state-of-the-art methods. Our code is available at https://github.com/Dstate/UAGLNet
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。