构建了92.5万张珊瑚图像的精细标注数据集,推动珊瑚自动识别研究。
ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognition
- 整合76个来源图像,点级标注匹配国际物种名录,覆盖39类硬珊瑚
- 建立高置信度基准集,专家一致率达92%,支持跨域少样本评估
- 揭示通用多模态模型在跨源迁移和长尾类别上仍有明显性能差距
珊瑚礁正因人为压力(如气候变化)快速退化,亟需可扩展的自动化监测手段。然而,当前数据驱动的珊瑚分析受限于缺乏大规模、细粒度且跨站点一致的标签数据集。为此,我们推出ReefNet,一个大型公开珊瑚礁图像数据集,包含点级标注并映射至世界海洋物种名录(WoRMS)分类体系。ReefNet整合了76个经筛选的CoralNet数据源及红海Al-Wajh的一个新礁区,共约92.5万条硬珊瑚属级标注。通过专家验证与针对性过滤,获得高置信度基准子集,涵盖39类硬珊瑚,专家一致性达92%。该数据集支持零样本、跨域小样本适应、同源评估及跨源迁移至Al-Wajh数据集的全面基准测试。对先进视觉语言模型(VLMs)、多模态大语言模型(MLLMs)和纯视觉骨干网络的实验表明,在零样本和极少数样本场景下性能显著下降,虽引入领域内监督可大幅提升表现,但在跨源迁移和长尾类别的识别上仍存在持续差距。结果凸显通用多模态模型在生物多样性监测中的根本性挑战,并强调构建大规模、基于分类学、高质量数据集的重要性。ReefNet既可作为基准,也可用于训练,以推进精细化珊瑚礁理解。
原文摘要 · Abstract (English)
Coral reefs are rapidly declining under anthropogenic pressures (e.g., climate change), creating an urgent need for scalable and automated monitoring. Progress in data-driven coral analysis, however, is constrained by the scarcity of large-scale datasets with fine-grained labels that are taxonomically consistent across sites and studies. To address this gap, we introduce ReefNet, a large-scale public coral reef image dataset with point-level annotations mapped to the World Register of Marine Species (WoRMS) taxonomy. ReefNet aggregates imagery from 76 curated CoralNet sources and an additional reef site from Al-Wajh (Red Sea), totaling approximately 925K genus-level hard coral annotations. Through expert-driven verification and targeted filtering, we derive a high-confidence benchmark subset with 92% expert agreement over 39 hard-coral label classes, enabling reliable evaluation under realistic label noise and strong class imbalance. Beyond dataset construction, we establish a comprehensive benchmark spanning zero-shot, cross-domain few-shot adaptation, within-source evaluation, and cross-source transfer to the Al-Wajh dataset. Experiments with state-of-the-art vision-language models (VLMs), multimodal large language models (MLLMs), and vision-only backbones reveal substantial degradation in zero-shot and extremely few-shot regimes, while adaptation with in-domain supervision yields large gains yet still leaves a persistent gap under cross-source shift and on long-tail genera. These results highlight fundamental challenges in applying general-purpose multimodal models to biodiversity monitoring and underscore the importance of large-scale, taxonomically grounded, high-quality datasets. ReefNet serves as both a benchmark and a training resource for advancing fine-grained coral reef understanding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。