arXiv:2505.22065cs.CV2025-05被引 2

首个用于水生无脊椎动物监测的多模态图像数据集,支持自动化识别研究。

AquaMonitor: A multimodal multi-view image sequence dataset for real-life aquatic invertebrate biodiversity monitoring

  • 采集两年实地监测图像,实现多视角多模态数据标准化
  • 含270万张图像、1358个物种的DNA序列及1494个个体测量数据
  • 针对实际监测挑战设计三类基准任务,适合生态与计算机视觉交叉研究

本文提出AquaMonitor数据集,是首个基于常规环境监测收集的水生无脊椎动物大规模计算机视觉数据集。现有大型物种识别数据集多未采用标准化采集流程,且极少聚焦水生无脊椎动物——这类生物采集极为耗时。AquaMonitor对两年监测中所有可成像标本进行了拍摄,构建了真实场景下具有挑战性且无偏的评估环境。数据集包含270万张图像、43,189个标本、1358个样本的DNA序列以及1494个样本的干重和尺寸测量数据,是目前规模最大的生物多视角多模态数据集之一。我们定义三项基准任务:1)监测基准,涵盖开集识别、分布偏移和极端类别不平衡等现实挑战;2)分类基准,采用标准细粒度视觉分类设置;3)少样本基准,针对极细粒度类别中训练样本极少的情况。在监测基准上的进展可直接提升水生生物多样性监测水平,而该能力是许多国家法定水质评估的重要组成部分。

原文摘要 · Abstract (English)

This paper presents the AquaMonitor dataset, the first large computer vision dataset of aquatic invertebrates collected during routine environmental monitoring. While several large species identification datasets exist, they are rarely collected using standardized collection protocols, and none focus on aquatic invertebrates, which are particularly laborious to collect. For AquaMonitor, we imaged all specimens from two years of monitoring whenever imaging was possible given practical limitations. The dataset enables the evaluation of automated identification methods for real-life monitoring purposes using a realistically challenging and unbiased setup. The dataset has 2.7M images from 43,189 specimens, DNA sequences for 1358 specimens, and dry mass and size measurements for 1494 specimens, making it also one of the largest biological multi-view and multimodal datasets to date. We define three benchmark tasks and provide strong baselines for these: 1) Monitoring benchmark, reflecting real-life deployment challenges such as open-set recognition, distribution shift, and extreme class imbalance, 2) Classification benchmark, which follows a standard fine-grained visual categorization setup, and 3) Few-shot benchmark, which targets classes with only few training examples from very fine-grained categories. Advancements on the Monitoring benchmark can directly translate to improvement of aquatic biodiversity monitoring, which is an important component of regular legislative water quality assessment in many countries.

生物监测多模态细粒度分类少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。