arXiv:2508.18958cs.CVcs.AI2025-08被引 2

用无人机影像和弱监督学习,实现无像素标注的大规模珊瑚栖息地分割

A drone-based framework for coral habitat mapping via weakly supervised segmentation

  • 通过分类结果生成粗略标签,训练高分辨率分割模型
  • 在珊瑚礁区域达86.07%像素准确率,mIoU为52.23%
  • 适合缺乏标注数据的生态监测场景,可扩展新类别

在大范围空间上获取像素级标注仍是机器学习在生态应用中的主要瓶颈。本文提出一种多尺度弱监督语义分割(WSSS)框架,利用密集的分类输出训练高分辨率分割模型。方法结合水下图像的细粒度多标签预测与航空影像的广覆盖数据,将点级分类转化为粗略监督掩码,用于在无人机正射影像上训练语义分割模型。随后使用模型自身优化后的预测进行第二阶段训练,无需额外标注即可提升空间精度。在珊瑚礁影像上验证该方法,实现了珊瑚形态类型的大幅面分割,并展示了对新类别的灵活性。最终模型在人工标注的珊瑚区达到86.07%像素准确率和52.23%平均交并比(mIoU),证明了无需像素标注即可实现高精度大规模珊瑚分割的可行性。该方法跨越尺度与模态,桥接图像分类与分割,为无标注环境下的分割模型部署提供高效解决方案,推动生态监测的规模化与高效化。

原文摘要 · Abstract (English)

Obtaining pixel-level annotations over large spatial extents remains a major bottleneck for deploying machine learning in ecological applications. Here we present a multi-scale weakly supervised semantic segmentation (WSSS) framework that enables training high-resolution segmentation models from dense, classification-based outputs. Our method combines fine-scale, multi-label predictions from underwater imagery with broad-coverage aerial data. We convert these point-level classifications into coarse supervision masks that can be used to train a semantic segmentation model on Unmanned Aerial Vehicle (UAV) orthophotos. A second training step using the model's own refined predictions is then used to further improve spatial accuracy without requiring additional annotations. We demonstrate the approach on coral reef imagery, enabling large-area segmentation of coral morphotypes and illustrating its flexibility in integrating new classes. The final model achieves 86.07% pixel accuracy and 52.23% mean Intersection over Union (mIoU) on manually annotated reef zones, demonstrating that accurate large-scale coral segmentation can be obtained without pixel-level annotations. By bridging image classification and segmentation across scales and modalities, this method provides an efficient solution for deploying segmentation models in settings where annotations are unavailable and opens opportunities for scalable, efficient monitoring in ecology and beyond.

弱监督学习珊瑚监测无人机影像语义分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。