arXiv:2608.24756cs.CVcs.LG2026-08

用图像级标签实现声呐图海草栖息地精准分割,大幅降低标注成本。

Weakly Supervised Seafloor Segmentation for Seagrass Habitat Mapping in Side-Scan Sonar Imagery

论文配图:Weakly Supervised Seafloor Segmentation for Seagrass Habitat Mapping in Side-Scan Sonar Imagery
图 1 · 摘自论文原文
  • 基于视觉变压器的弱监督框架,仅凭图像标签生成像素级地图。
  • 伪标签精度达mIoU 89.3%,模型无像素标签训练仍达87.6%。
  • 适用于深水浑浊区海草监测,适合大范围海岸带生态评估。

海草床是关键的蓝碳生境,其分布制图是海岸管理与碳核算的前提。光学遥感虽覆盖广但无法穿透深水或浑浊水域,而侧扫声呐(SSS)可在任意深度高分辨率成像海底。然而,当前解读仍依赖密集人工标注,效率低且成本高。本文将弱监督语义分割框架适配于SSS底栖生境制图,仅用图像级标签即可学习像素级地图。框架结合基于ViT的编码器-解码器与分类分支,提取类别激活图,并通过调优的密集条件随机场对噪声和弱边界进行伪标签优化。采用迭代自训练与采样策略应对数据强类别不平衡问题。研究不同损失函数效果,发现Lovász-Softmax表现最佳。在保留航段上,优化后的伪标签达到89.3% mIoU,分割分支在无任何像素标签情况下达成87.6%。在未标记声呐数据上进行自监督预训练,进一步提升3% mIoU。实地试验验证了模型泛化能力。结果表明,基于侧扫声呐的大范围、高精度、低成本底栖生境制图具备可行性。

原文摘要 · Abstract (English)

Seagrass meadows are crucial blue-carbon habitats, and mapping their extent is a prerequisite for coastal management and carbon inventory. Optical satellite sensors cover large areas but cannot reach deep or turbid water, whereas side-scan sonar (SSS) images the seabed at high resolution and at any depth. Interpreting SSS, however, still relies on dense manual annotation, which is slow and costly. We address this by adapting a weakly supervised semantic segmentation framework to SSS benthic habitat mapping, so that pixel-level maps are learned from image-level labels alone. The framework couples a ViT-based encoder-decoder with a classification branch, extracts class activation maps, and refines them into pseudo-labels with a dense conditional random field that we tune for the noise and weak boundaries of acoustic imagery. It follows an iterative self-training scheme, together with a sampling strategy to cope with the strong class imbalance of the data. We also study the effect of different loss functions on segmentation quality, finding Lovász-Softmax loss the most effective. On a held-out transect, the refined pseudo-labels reached an mIoU of 89.3\% against the ground truth, and the segmentation branch, trained without any pixel-level labels, reached 87.6\%. Self-supervised pretraining on unlabelled SSS added a further 3\% in mean intersection-over-union. Field trials further demonstrate the generalizability of the trained model. These results show that accurate and label-efficient benthic habitat mapping from side-scan sonar is feasible at the scale needed for coast-wide seagrass monitoring.

弱监督声呐图像海草监测语义分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。