用自监督预训练提升海底图像分类精度,尤其在标注缺失时表现更优。
Hierarchical Multi-Label Classification with Missing Information for Benthic Habitat Imagery
- 在多级标签缺失场景下,利用域内自监督预训练实现高效分类。
- 小规模标注数据上,域内预训练模型优于ImageNet预训练模型。
- 适用于区域性海洋科研项目,为水下图像自动标注提供新范式。
本文在大规模海底影像数据集BenthicNet上应用先进的自监督学习技术,研究其在复杂多级标签(HML)分类任务中的表现。特别地,我们展示了在存在多层级标注缺失情况下的HML训练能力,这在由不同研究团队以不同协议采集的异构真实数据中具有重要意义。实验发现,当使用典型区域性海洋科学项目的小规模单热编码图像标签数据集时,基于更大规模域内海底数据进行自监督预训练的模型,性能优于在ImageNet上预训练的模型。在多级标签设置下,若模型在域内数据上进行自监督预训练,可实现更深层、更精确的分类。本工作旨在为自动化水下图像标注任务建立基准,并指导其他具有层级标注与混合分辨率数据的领域研究。
原文摘要 · Abstract (English)
In this work, we apply state-of-the-art self-supervised learning techniques on a large dataset of seafloor imagery, \textit{BenthicNet}, and study their performance for a complex hierarchical multi-label (HML) classification downstream task. In particular, we demonstrate the capacity to conduct HML training in scenarios where there exist multiple levels of missing annotation information, an important scenario for handling heterogeneous real-world data collected by multiple research groups with differing data collection protocols. We find that, when using smaller one-hot image label datasets typical of local or regional scale benthic science projects, models pre-trained with self-supervision on a larger collection of in-domain benthic data outperform models pre-trained on ImageNet. In the HML setting, we find the model can attain a deeper and more precise classification if it is pre-trained with self-supervision on in-domain data. We hope this work can establish a benchmark for future models in the field of automated underwater image annotation tasks and can guide work in other domains with hierarchical annotations of mixed resolution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。