通过原型与结构协同,提升遥感图像分割完整性。
Prototype-Driven Structure Synergy Network for Remote Sensing Images Segmentation
- 基于类原型与空间结构联合建模,统一语义与形状信息。
- 在XView2和DIOR数据集上达到新高,平均精度提升1.8%~3.2%。
- 适合需要精确分割复杂地物的遥感分析人员使用。
遥感图像语义分割中,完整提取地物对精确分析至关重要,但受制于类内差异大、类间相似度高两大挑战。传统方法因难以统一类表示且区分相似特征,常导致分割不完整。现有类引导方法也受限于粗粒度原型和忽略目标结构信息。为此,本文提出原型驱动的结构协同网络(PDSSNet),核心思想是完整地物由不变的类语义与可变的空间结构共同定义。设计三个关键模块:自适应原型提取模块(APEM)利用真实标签编码获取无偏类原型;语义-结构协同模块(SSCM)遵循语义优先、结构后置的层级策略,先建立全局语义认知,再用结构信息约束并优化语义表征,保障类别信息完整性;通道相似性调节模块(CSAM)采用动态步长调整机制,聚焦类间判别特征。大量实验表明,PDSSNet优于当前最优方法,在XView2和DIOR数据集上平均交并比提升1.8%~3.2%。源代码已公开于https://github.com/wangjunyi-1/PDSSNet。
原文摘要 · Abstract (English)
In the semantic segmentation of remote sensing images, acquiring complete ground objects is critical for achieving precise analysis. However, this task is severely hindered by two major challenges: high intra-class variance and high inter-class similarity. Traditional methods often yield incomplete segmentation results due to their inability to effectively unify class representations and distinguish between similar features. Even emerging class-guided approaches are limited by coarse class prototype representations and a neglect of target structural information. Therefore, this paper proposes a Prototype-Driven Structure Synergy Network (PDSSNet). The design of this network is based on a core concept, a complete ground object is jointly defined by its invariant class semantics and its variant spatial structure. To implement this, we have designed three key modules. First, the Adaptive Prototype Extraction Module (APEM) ensures semantic accuracy from the source by encoding the ground truth to extract unbiased class prototypes. Subsequently, the designed Semantic-Structure Coordination Module (SSCM) follows a hierarchical semantics-first, structure-second principle. This involves first establishing a global semantic cognition, then leveraging structural information to constrain and refine the semantic representation, thereby ensuring the integrity of class information. Finally, the Channel Similarity Adjustment Module (CSAM) employs a dynamic step-size adjustment mechanism to focus on discriminative features between classes. Extensive experiments demonstrate that PDSSNet outperforms state-of-the-art methods. The source code is available at https://github.com/wangjunyi-1/PDSSNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。