arXiv:2501.10736cs.CVcs.AI2025-01被引 29

提出多尺度不确定性一致性与跨教师-学生注意力机制,提升遥感图像分割精度。

Semi-supervised Semantic Segmentation for Remote Sensing Images via Multi-scale Uncertainty Consistency and Cross-Teacher-Student Attention

  • 通过多尺度不确定性一致性约束网络各层特征一致性。
  • 在爱达和普茨坦数据集上达到领先性能,尤其擅长区分相似地物。
  • 适合关注遥感图像半监督分割的科研与工程人员。

半监督学习为缓解遥感图像语义分割中像素级标注的劳动成本提供了有效方案。然而,遥感图像具有丰富的多尺度特征和高类别相似性等独特挑战。为此,本文提出一种新型半监督多尺度不确定性与跨教师-学生注意力(MUCA)模型。该模型通过引入多尺度不确定性一致性正则化,约束网络不同层特征图的一致性,增强算法对未标注数据的多尺度学习能力。同时,设计跨教师-学生注意力机制,引导学生网络利用教师网络的互补特征构建更具判别性的表示,有效融合弱增强与强增强数据以进一步提升分割性能。在ISPRS-Potsdam与LoveDA数据集上的大量实验表明,本方法优于现有先进半监督方法,尤其在区分高度相似目标方面表现突出,展现出推动遥感图像半监督分割发展的潜力。

原文摘要 · Abstract (English)

Semi-supervised learning offers an appealing solution for remote sensing (RS) image segmentation to relieve the burden of labor-intensive pixel-level labeling. However, RS images pose unique challenges, including rich multi-scale features and high inter-class similarity. To address these problems, this paper proposes a novel semi-supervised Multi-Scale Uncertainty and Cross-Teacher-Student Attention (MUCA) model for RS image semantic segmentation tasks. Specifically, MUCA constrains the consistency among feature maps at different layers of the network by introducing a multi-scale uncertainty consistency regularization. It improves the multi-scale learning capability of semi-supervised algorithms on unlabeled data. Additionally, MUCA utilizes a Cross-Teacher-Student attention mechanism to guide the student network, guiding the student network to construct more discriminative feature representations through complementary features from the teacher network. This design effectively integrates weak and strong augmentations (WA and SA) to further boost segmentation performance. To verify the effectiveness of our model, we conduct extensive experiments on ISPRS-Potsdam and LoveDA datasets. The experimental results show the superiority of our method over state-of-the-art semi-supervised methods. Notably, our model excels in distinguishing highly similar objects, showcasing its potential for advancing semi-supervised RS image segmentation tasks.

遥感分割半监督学习多尺度特征注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。