用深海与空中影像结合,提升珊瑚礁监测精度与覆盖范围。
From underwater to aerial: a novel multi-scale knowledge distillation approach for coral reef monitoring
- 通过跨尺度知识蒸馏,将水下图像标注迁移到空中影像。
- 在31类珊瑚形态与生境上实现0.9251的AUC准确率。
- 适合需要大范围高精度珊瑚礁监测的研究者使用。
基于无人机遥感与人工智能的方法在珊瑚礁生态系统的精准制图与监测中展现出巨大潜力。本研究提出一种新型多尺度珊瑚礁监测方法,融合细粒度水下影像与中等尺度空中影像。水下图像由自主水面载具(ASV)采集,空中影像由无人机获取。基于变换器的深度学习模型在水下图像上训练,用于识别31类珊瑚形态、伴生生物及生境。这些预测结果作为标注数据,用于训练应用于空中影像的第二阶段模型。跨尺度信息传递通过加权足迹法实现,考虑了水下影像覆盖区域与空中影像瓦片之间的部分重叠。结果表明,该多尺度方法成功将细粒度分类扩展至更大礁区,对珊瑚形态与相关生境的预测具有高准确性。方法在水下推断与真实数据间表现出强一致性,AUC得分为0.9251。这表明,结合水下与空中影像并辅以深度学习模型,可实现可扩展且精准的礁区评估。本研究展示了多尺度成像与AI结合在珊瑚礁监测与保护中的潜力,有效整合水下与空中影像优势,在保持细粒度分析精度的同时拓展覆盖范围。
原文摘要 · Abstract (English)
Drone-based remote sensing combined with AI-driven methodologies has shown great potential for accurate mapping and monitoring of coral reef ecosystems. This study presents a novel multi-scale approach to coral reef monitoring, integrating fine-scale underwater imagery with medium-scale aerial imagery. Underwater images are captured using an Autonomous Surface Vehicle (ASV), while aerial images are acquired with an aerial drone. A transformer-based deep-learning model is trained on underwater images to detect the presence of 31 classes covering various coral morphotypes, associated fauna, and habitats. These predictions serve as annotations for training a second model applied to aerial images. The transfer of information across scales is achieved through a weighted footprint method that accounts for partial overlaps between underwater image footprints and aerial image tiles. The results show that the multi-scale methodology successfully extends fine-scale classification to larger reef areas, achieving a high degree of accuracy in predicting coral morphotypes and associated habitats. The method showed a strong alignment between underwater-derived annotations and ground truth data, reflected by an AUC (Area Under the Curve) score of 0.9251. This shows that the integration of underwater and aerial imagery, supported by deep-learning models, can facilitate scalable and accurate reef assessments. This study demonstrates the potential of combining multi-scale imaging and AI to facilitate the monitoring and conservation of coral reefs. Our approach leverages the strengths of underwater and aerial imagery, ensuring the precision of fine-scale analysis while extending it to cover a broader reef area.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。