arXiv:2411.11287cs.CV2024-11综述被引 4

降低水下图像分析对专家标注的依赖,推动自动化海洋监测

Reducing Label Dependency for Underwater Scene Understanding: A Survey of Datasets, Techniques and Applications

  • 提出弱监督与自监督学习框架,减少对专业标注的依赖
  • 系统梳理现有水下数据集与平台,揭示标注瓶颈与技术缺口
  • 适合关注海洋生态监测与少样本视觉算法的研究者

水下调查为制定管理策略、监测珊瑚礁健康状况及估算蓝碳储量提供了长期数据支持。随着机器人水下设备等广域调查方法的进步,海洋调查范围扩大,但产生了大量需分析的图像。计算机视觉中的语义分割等方法可辅助自动化图像分析,但通常依赖大量人工标注数据进行全监督训练。尽管街景分割可通过众包快速低成本获取标注,生态学领域因水下图像复杂且物种像素级识别需专业知识,导致标注成本高、耗时长,严重依赖领域专家。近年来,部分研究开始探索水下图像的自动化分析,少数工作聚焦于弱监督方法以减少专家标注需求。本文综述了降低人类专家输入依赖的方法,回顾相关技术以定位其在水下感知领域的地位。同时,概述沿海生态系统及水下图像挑战,介绍弱监督与自监督深度学习背景,并构建以水下监测、计算机视觉与深度学习交集为核心的分类体系,论证减少专家标注依赖的弱监督深度学习路径。最后,评估现有数据集与平台,识别自动化水下调查中的空白、障碍与机遇。

原文摘要 · Abstract (English)

Underwater surveys provide long-term data for informing management strategies, monitoring coral reef health, and estimating blue carbon stocks. Advances in broad-scale survey methods, such as robotic underwater vehicles, have increased the range of marine surveys but generate large volumes of imagery requiring analysis. Computer vision methods such as semantic segmentation aid automated image analysis, but typically rely on fully supervised training with extensive labelled data. While ground truth label masks for tasks like street scene segmentation can be quickly and affordably generated by non-experts through crowdsourcing services like Amazon Mechanical Turk, ecology presents greater challenges. The complexity of underwater images, coupled with the specialist expertise needed to accurately identify species at the pixel level, makes this process costly, time-consuming, and heavily dependent on domain experts. In recent years, some works have performed automated analysis of underwater imagery, and a smaller number of studies have focused on weakly supervised approaches which aim to reduce the expert-provided labelled data required. This survey focuses on approaches which reduce dependency on human expert input, while reviewing the prior and related approaches to position these works in the wider field of underwater perception. Further, we offer an overview of coastal ecosystems and the challenges of underwater imagery. We provide background on weakly and self-supervised deep learning and integrate these elements into a taxonomy that centres on the intersection of underwater monitoring, computer vision, and deep learning, while motivating approaches for weakly supervised deep learning with reduced dependency on domain expert data annotations. Lastly, the survey examines available datasets and platforms, and identifies gaps, barriers, and opportunities for automating underwater surveys.

水下视觉弱监督生态监测数据集综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。