通过双向协同精炼提升高分辨率遥感图像分割精度与可解释性
BiCoR-Seg: Bidirectional Co-Refinement Framework for High-Resolution Remote Sensing Image Segmentation
- 设计热图驱动的双向信息融合模块,连接特征图与类别嵌入
- 在LoveDA、Vaihingen、Potsdam上达到领先性能,边界更清晰
- 生成可解释热图,适合需要可视化结果的遥感分析场景
高分辨率遥感图像语义分割(HRSS)是地球观测中的基础且关键任务,但长期面临类间相似度高、类内差异大的挑战。现有方法难以有效将抽象而强区分性的语义知识注入像素级特征学习,导致复杂场景中边界模糊与类别混淆。为此,本文提出双向协同精炼框架(BiCoR-Seg)。设计热图驱动的双向信息协同模块(HBIS),通过生成类别级热图实现特征图与类别嵌入间的双向信息流动。基于HBIS,引入分层监督策略,利用各模块生成的可解释热图作为低分辨率分割预测进行监督,增强浅层特征的区分能力。此外,提出跨层类别嵌入的Fisher判别损失,强化类内紧凑性并扩大类间可分性。在LoveDA、Vaihingen和Potsdam数据集上的大量实验表明,BiCoR-Seg在分割性能上表现卓越,同时具备更强可解释性。代码已开源:https://github.com/ShiJinghao566/BiCoR-Seg。
原文摘要 · Abstract (English)
High-resolution remote sensing image semantic segmentation (HRSS) is a fundamental yet critical task in the field of Earth observation. However, it has long faced the challenges of high inter-class similarity and large intra-class variability. Existing approaches often struggle to effectively inject abstract yet strongly discriminative semantic knowledge into pixel-level feature learning, leading to blurred boundaries and class confusion in complex scenes. To address these challenges, we propose Bidirectional Co-Refinement Framework for HRSS (BiCoR-Seg). Specifically, we design a Heatmap-driven Bidirectional Information Synergy Module (HBIS), which establishes a bidirectional information flow between feature maps and class embeddings by generating class-level heatmaps. Based on HBIS, we further introduce a hierarchical supervision strategy, where the interpretable heatmaps generated by each HBIS module are directly utilized as low-resolution segmentation predictions for supervision, thereby enhancing the discriminative capacity of shallow features. In addition, to further improve the discriminability of the embedding representations, we propose a cross-layer class embedding Fisher Discriminative Loss to enforce intra-class compactness and enlarge inter-class separability. Extensive experiments on the LoveDA, Vaihingen, and Potsdam datasets demonstrate that BiCoR-Seg achieves outstanding segmentation performance while offering stronger interpretability. The released code is available at https://github.com/ShiJinghao566/BiCoR-Seg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。