arXiv:2607.02559cs.CV2026-07被引 1

用少量标注数据即可在新海域可靠识别海洋物种,省时省力。

How many labels do you need? A decision framework for cross-habitat marine species recognition

论文配图:How many labels do you need? A decision framework for cross-habitat marine species recognition
图 1 · 摘自论文原文
  • 冻结预训练模型+线性分类器,跨环境迁移效果好。
  • 每类仅需10-20张标注图,准确率仍高,标注量减少90%。
  • 适合生态监测项目快速部署,尤其缺标注资源的场景。

自动化图像识别正推动生态监测规模扩展,但缺乏可靠的标注工作量指导。本文提出决策框架,量化跨海洋生境迁移中标注成本与识别精度的权衡。实验涵盖五个数据集、三大洋和三类生物(鱼类、珊瑚、无脊椎动物),覆盖大堡礁、法属波利尼西亚热带礁区至丹麦温带峡湾。评估四种模型(DINOv2、CLIP、ResNet-50、EfficientNet-B4)在四种适配策略(线性探针、LoRA、视觉提示调优、全微调)下的表现,共648次运行。结果表明,冻结自监督基础特征(如DINOv2 + 线性分类器,仅1,538个可训练参数)在未见礁区上的泛化能力不亚于全微调卷积基线(参数量大四数量级);前者学习到物种诊断性、生境不变表征,后者则捕捉生境特异性捷径而失效。仅需每类10–20张标注图像即可实现可靠识别,标注成本降低约一个数量级。建议生态项目采用冻结的开放基础模型(如DINOv2)搭配简单线性分类器,每类标注10–20张,约1–4小时/站点。该框架支持按站点、生态系统和平台预算标注量与预期精度。

原文摘要 · Abstract (English)

Automated image recognition is increasingly used to scale ecological monitoring beyond manual annotation, yet ecologists lack evidence-based guidance on how much labelling effort reliable deployment at new sites requires. We present a decision framework quantifying the trade-off between labelling effort and recognition accuracy when transferring vision systems across marine habitats. The benchmark spans five datasets, three oceans, and three taxonomic groups (fish, corals, invertebrates), from tropical reefs in the Great Barrier Reef and French Polynesia to a temperate Danish fjord. We evaluated four recognition models (DINOv2, CLIP, ResNet-50, EfficientNet-B4) under four adaptation strategies (linear probing, LoRA, Visual Prompt Tuning, full fine-tuning) across three protocols: within-habitat transfer across 20 reef sites (240 runs), cross-dataset geographic transfer along a difficulty gradient (40 runs), and few-shot adaptation curves with 0-100 labelled samples per class (648 runs). Frozen self-supervised foundation features (DINOv2 + linear classifier, 1,538 trainable parameters) generalised to unseen reef sites at least as well as fully fine-tuned convolutional baselines four orders of magnitude larger; they learned species-diagnostic, habitat-invariant representations, whereas baselines encoded habitat-specific shortcuts that fail at new sites. As few as 10-20 labelled images per species sufficed to deploy reliable recognition at a new site, cutting annotation effort by roughly an order of magnitude. Solution. Programmes expanding to new sites can deploy reliable recognition by pairing a frozen, open foundation model (DINOv2) with a simple linear classifier and annotating only 10-20 images per species - roughly 1-4 hours per site. The framework lets programmes budget labelling effort against expected accuracy across sites, ecosystems, and platforms.

生态监测少样本识别迁移学习海洋生物

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。