用已有稀疏标注点提升海底图像细粒度分割精度
Leveraging existing sparse point annotations for benthic imagery dense segmentation

- 利用历史稀疏标注点作为提示,自动筛选有效点
- 过滤有害点后生成高质量伪标签,训练更准模型
- 适合生态监测与海洋研究者使用
海洋生态系统健康是全球环境变化的关键指标,但水下观测的物理限制和海洋图像处理的内在挑战严重制约了系统性监测的可扩展性。尽管近期视觉基础模型如SAM系列展现出巨大潜力,但在复杂场景中仍难以实现细粒度识别,且需专家监督。本文通过将先进基础模型与现有稀疏监督结合,解决这一问题:由于历史海底调查通常每图仅标注少量专家点,我们利用这些遗留点作为SAM2的视觉提示。主要贡献在于提出一种新机制,可自动识别哪些点适合用于传播,哪些点会带来负面影响。通过过滤不可靠点,我们提取出高质量伪真值掩码,用于训练更精确的细粒度语义分割模型。我们在公开海底数据上验证了该方法的有效性,并引入一个包含真实世界稀疏专家标注的新基准,为可扩展生态分析铺平道路。
原文摘要 · Abstract (English)
The health of marine ecosystems is a critical indicator of global environmental change, yet the physical constraints of underwater observation and the intrinsic challenges of processing marine imagery severely limit the scalability of systematic monitoring. While recent visual foundation models such as the Segment Anything Model (SAM) series show great promise, they still struggle with the fine-grained recognition required in these complex scenarios and still require expert supervision. Our work addresses this gap by bridging state-of-the-art foundation models with existing sparse supervision. Because historical benthic surveys are typically annotated with only a few sparse expert points per image, we utilize these legacy point-labels as visual prompts for SAM2. Our primary contribution is a novel mechanism to automatically identify which of these points are suitable, and which are actively harmful, when used for propagation. By filtering out unreliable points, we extract high-quality pseudo-ground-truth masks capable of training more accurate, fine-grained semantic segmentation models. We demonstrate the effectiveness of our approach on public benthic data and introduce a new, challenging benchmark featuring real-world sparse expert annotations, paving the way for scalable ecological analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。