提出新网络提升遥感图像分割精度,解决背景复杂与类内差异大问题。
A Novel Scene Coupling Semantic Mask Network for Remote Sensing Image Segmentation
- 引入场景耦合与局部全局语义掩码,重构注意力机制
- 在四个基准数据集上显著优于传统方法,提升分割效果
- 适合遥感图像分析、地理信息处理等应用领域研究者
在计算机视觉领域,空间注意力机制因其建模长距离依赖的优异能力,被广泛应用于遥感图像语义分割。然而,遥感图像常具有复杂背景和较大的类内差异,导致分析性能下降。传统的空间注意力机制基于密集仿射变换,易引入大量背景上下文信息,且忽视特征间的内在空间相关性。为此,本文提出一种新型场景耦合语义掩码网络(SCSM),通过场景耦合模块将场景信息分解为全局表征与目标分布,并嵌入注意力亲和过程;同时,局部全局语义掩码模块利用局部语义掩码作为中间感知元素,间接关联像素与全局语义掩码,从而降低背景干扰并缓解类内差异影响。结合两种策略,所提模型在复杂场景下能高效分割多种地物对象,且具备简洁优美的数学表达。在四个基准数据集上的实验结果验证了该方法的有效性。代码与数据集已公开于 https://github.com/xwmaxwma/rssegmentation。
原文摘要 · Abstract (English)
As a common method in the field of computer vision, spatial attention mechanism has been widely used in semantic segmentation of remote sensing images due to its outstanding long-range dependency modeling capability. However, remote sensing images are usually characterized by complex backgrounds and large intra-class variance that would degrade their analysis performance. While vanilla spatial attention mechanisms are based on dense affine operations, they tend to introduce a large amount of background contextual information and lack of consideration for intrinsic spatial correlation. To deal with such limitations, this paper proposes a novel scene-Coupling semantic mask network, which reconstructs the vanilla attention with scene coupling and local global semantic masks strategies. Specifically, scene coupling module decomposes scene information into global representations and object distributions, which are then embedded in the attention affinity processes. This Strategy effectively utilizes the intrinsic spatial correlation between features so that improve the process of attention modeling. Meanwhile, local global semantic masks module indirectly correlate pixels with the global semantic masks by using the local semantic mask as an intermediate sensory element, which reduces the background contextual interference and mitigates the effect of intra-class variance. By combining the above two strategies, we propose the model SCSM, which not only can efficiently segment various geospatial objects in complex scenarios, but also possesses inter-clean and elegant mathematical representations. Experimental results on four benchmark datasets demonstrate the the effectiveness of the above two strategies for improving the attention modeling of remote sensing images. The dataset and code are available at https://github.com/xwmaxwma/rssegmentation
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。