用稀疏点引导融合监督与自监督学习,提升海藻分割精度。
Sparse Point-Guided Fusion of Supervised and Self-Supervised Learning Model for Seaweed Segmentation
- 先用监督学习定位海藻位置,再用自监督学习细化分割区域
- 在山口县水下图像上实现0.082 mIoU提升,小海藻分割更准
- 适合海洋碳汇监测和数字孪生中的海藻自动识别任务
海洋在可持续发展中至关重要,尤其是应对气候变化。蓝碳生态系统是重要的自然碳汇。本文针对海洋数字孪生中蓝碳量化所需的精准海藻分类问题,提出一种新型两阶段海藻分割方法。传统方法受限于数据稀缺和领域差异(监督学习),或无法分配类别标签(自监督学习),难以应对水下复杂环境与多样海藻。为此,我们提出基于监督与自监督学习传播(SSL.Prop.)的初始阶段,利用监督学习提供类别信息与粗略位置,引导自监督学习进行精细分割;随后通过掩码融合(MaskFusion, MF)整合实例级掩码,提升分割精度。该方法可自动标注类别并缓解领域偏移。实验使用山口县水下图像,完整方法(SSL.Prop.+MF)相比USIS-SAM提升0.082 mIoU,尤其显著改善小海藻分割效果。本方法对蓝碳量化与海洋生态系统监测具有重要应用潜力。
原文摘要 · Abstract (English)
The ocean plays a critical role in sustainable development, particularly in climate change mitigation. Among marine ecosystems, blue carbon ecosystems are recognized as important natural carbon sinks. In this context, this paper addresses precise seaweed classification for blue carbon quantification in Ocean Digital Twin initiatives. Conventional methods, including supervised learning (limited by data scarcity and domain gaps) and self-supervised learning (unable to assign class labels), struggle with underwater complexities and diverse seaweed species. To overcome this, we propose a novel two-stage seaweed segmentation technique. This technique first utilizes Supervised and Self-supervised Learning Model Propagation (SSL.Prop.), which leverages supervised learning for initial class information and approximate locations, guiding self-supervised learning for detailed, accurate segmentation. Subsequently, MaskFusion (MF) refines these results by merging instance-level masks for highly accurate segmentation. This integrated approach allows automatic class label assignment and mitigates domain gap effects. Specifically, instance segmentation estimates sparse point locations which then guide self-supervised learning for detailed region segmentation. Evaluated with underwater images from Yamaguchi Prefecture, our full proposed method (SSL.Prop.+MF) achieved a 0.082 mIoU improvement over USIS-SAM, demonstrating significant accuracy gains, particularly for small seaweed. This approach demonstrates strong potential for improving blue carbon quantification and marine ecosystem monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。