构建首个大规模浮游生物追踪数据集,提升水下微小生物实时追踪精度。
MPT: A Large-scale Multi-Phytoplankton Tracking Benchmark
- 构建覆盖27种浮游生物的多物种追踪数据集,含140段视频与14类复杂背景。
- 提出DSFT追踪算法,在焦点漂移和小目标丢失问题上显著提升跟踪稳定性。
- 适用于海洋生态监测、水下视觉追踪研究者,推动自动化生态观测发展。
浮游生物是水生生态系统的关键组成部分,有效监测可为海洋环境与生态系统变化提供重要洞察。传统监测方法通常复杂且缺乏实时分析能力,深度学习为此提供了自动化监测的可行路径。然而,高质量大规模训练样本的缺失已成为制约浮游生物追踪发展的主要瓶颈。本文提出一个具有挑战性的基准数据集——多浮游生物追踪(Multiple Phytoplankton Tracking, MPT),涵盖多样背景信息与观测中的运动变化。该数据集包含27种浮游生物与原生动物,14种不同背景以模拟复杂的水下环境,共140段视频。为实现浮游生物的精准实时观测,我们引入一种多目标追踪方法——偏差校正多尺度特征融合追踪器(Deviation-Corrected Multi-Scale Feature Fusion Tracker, DSFT),解决了追踪中焦点漂移及帧间相似性计算导致的小目标信息丢失问题。具体而言,通过额外特征提取器预测标准提取器输出的残差,并基于提取器不同层的特征计算多尺度帧间相似性。在MPT上的大量实验验证了数据集的有效性及DSFT在浮游生物追踪中的优越性,为浮游生物监测提供了有效解决方案。
原文摘要 · Abstract (English)
Phytoplankton are a crucial component of aquatic ecosystems, and effective monitoring of them can provide valuable insights into ocean environments and ecosystem changes. Traditional phytoplankton monitoring methods are often complex and lack timely analysis. Therefore, deep learning algorithms offer a promising approach for automated phytoplankton monitoring. However, the lack of large-scale, high-quality training samples has become a major bottleneck in advancing phytoplankton tracking. In this paper, we propose a challenging benchmark dataset, Multiple Phytoplankton Tracking (MPT), which covers diverse background information and variations in motion during observation. The dataset includes 27 species of phytoplankton and zooplankton, 14 different backgrounds to simulate diverse and complex underwater environments, and a total of 140 videos. To enable accurate real-time observation of phytoplankton, we introduce a multi-object tracking method, Deviation-Corrected Multi-Scale Feature Fusion Tracker(DSFT), which addresses issues such as focus shifts during tracking and the loss of small target information when computing frame-to-frame similarity. Specifically, we introduce an additional feature extractor to predict the residuals of the standard feature extractor's output, and compute multi-scale frame-to-frame similarity based on features from different layers of the extractor. Extensive experiments on the MPT have demonstrated the validity of the dataset and the superiority of DSFT in tracking phytoplankton, providing an effective solution for phytoplankton monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。