用点标注+AI自动生成框,高效识别鲸鱼与海豹,连模糊个体也管。
Beluga Whale Detection from Satellite Imagery with Point Labels
- 用点标注结合SAM模型生成精准检测框,减少人工标注量
- YOLOv8在密集场景下对鲸鱼和海豹的F1分数分别达72.2%和70.3%
- 能识别模糊个体,适合真实野外复杂环境,可扩展至其他物种
超高分辨率(VHR)卫星影像已成为大范围监测海洋动物的重要工具。然而,现有基于深度学习的鲸鱼检测方法通常依赖人工创建的高质量边界框标注,耗时费力;且多数研究排除“不确定鲸鱼”(外观模糊的个体),限制了实际应用。为此,本研究提出自动化流程,用于检测白鲸与竖琴海豹。该流程利用点标注与分割任意模型(SAM)生成精确边界框,训练YOLOv8实现对确定鲸鱼、不确定鲸鱼及竖琴海豹的多类检测。实验表明,SAM生成的标注显著提升检测性能,相比传统缓冲法获得更高F1分数。在整体场景中,鲸鱼检测的F1得分为72.2%,海豹为70.3%,密集场景表现优异。该方法不仅降低人工标注成本,还增强对不确定个体的识别能力,提供更全面的海洋生物监测方案。该方法具有扩展至其他物种、栖息地及遥感平台的潜力,并可用于鲸鱼体型估算,助力生态监测与保护。代码已开源:http://github.com/voyagerxvoyagerx/beluga-seeker。
原文摘要 · Abstract (English)
Very high-resolution (VHR) satellite imagery has emerged as a powerful tool for monitoring marine animals on a large scale. However, existing deep learning-based whale detection methods usually require manually created, high-quality bounding box annotations, which are labor-intensive to produce. Moreover, existing studies often exclude ``uncertain whales'', individuals that have ambiguous appearances in satellite imagery, limiting the applicability of these models in real-world scenarios. To address these limitations, this study introduces an automated pipeline for detecting beluga whales and harp seals in VHR satellite imagery. The pipeline leverages point annotations and the Segment Anything Model (SAM) to generate precise bounding box annotations, which are used to train YOLOv8 for multiclass detection of certain whales, uncertain whales, and harp seals. Experimental results demonstrated that SAM-generated annotations significantly improved detection performance, achieving higher $\text{F}_\text{1}$-scores compared to traditional buffer-based annotations. YOLOv8 trained on SAM-labeled boxes achieved an overall $\text{F}_\text{1}$-score of 72.2% for whales overall and 70.3% for harp seals, with superior performance in dense scenes. The proposed approach not only reduces the manual effort required for annotation but also enhances the detection of uncertain whales, offering a more comprehensive solution for marine animal monitoring. This method holds great potential for extending to other species, habitats, and remote sensing platforms, as well as for estimating whale biometrics, thereby advancing ecological monitoring and conservation efforts. The codes for our label and detection pipeline are publicly available at http://github.com/voyagerxvoyagerx/beluga-seeker .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。