针对浮游生物识别中未知类导致的群落估算偏差,提出基于群落层面的评估与校准方法。
Community-aware evaluation and threshold calibration for open-set plankton image recognition

- 设计群落畸变指标OSCD,量化已知类与未知类的估计误差
- 发现传统阈值导致已知类被误判为未知,引发群落结构严重失真
- 提出群落感知校准策略,提升生态监测中的分类可靠性
自动化浮游生物图像识别广泛用于水生生态系统监测,但部署的分类器常遭遇未见类群和非目标颗粒。现有开集识别评估多采用样本级指标(如AUROC、AUPR、FPR@95%未知召回率),而生态监测依赖于类群丰度与多样性等群落级估计。本研究通过控制伪群落,在三个数据集(ZooScan海洋动物浮游生物、IFCB海洋植物浮游生物、原位相机淡水浮游生物)上检验了目标不匹配问题。定义开集群落畸变(OSCD),一种类似Bray-Curtis的误差度量,包含已知类与未知类的综合偏差,并区分高估与低估方向。封闭集分类器在已知类上准确率高,但未知样本常被高置信度归入未知类别且呈结构性分布。样本级OOD指标不足以选择生态适用操作点:以MSP为例,95%未知召回率阈值在所有数据集上均导致显著测试群落OSCD,主因是真实已知类被过度拒绝至未知箱。群落感知阈值校准在SYKE-ZooScan 2024与SYKE-IFCB 2022上显著降低MSP的OSCD,而在ZooLake上固定召回基线已接近最优,最佳群落级方法为原型距离变体而非MSP。结果表明,群落感知校准的收益取决于验证群落的代表性及固定召回与群落最优间的差距。研究强调,开集浮游生物识别应作为生态测量问题评估,而非仅限样本级检测任务。
原文摘要 · Abstract (English)
Automated plankton image recognition is increasingly used in aquatic ecosystem monitoring, but deployed classifiers inevitably encounter unseen taxa and non-target particles. Open-set recognition methods are usually evaluated with sample-level metrics such as AUROC, AUPR, and FPR@95% unknown-recall operating points, whereas ecological monitoring depends on community-level estimates of taxon abundance and diversity. This study examines the mismatch between these objectives using controlled pseudo-communities and three datasets spanning marine zooplankton imaged by ZooScan, marine phytoplankton imaged by IFCB, and freshwater plankton imaged by an in-situ camera. We define Open-Set Community Distortion (OSCD), a Bray-Curtis-style error over known taxa plus an unknown bin, with directional components distinguishing known-taxon overestimation from underestimation. Closed-set classifiers achieved high known-class accuracy, but unknown samples were often absorbed with high confidence and in structured ways. Sample-level OOD metrics were not sufficient to select ecological operating points: for MSP, FPR@95% unknown-recall thresholds produced large test-community OSCD on all three datasets mainly because true known taxa were over-rejected into the unknown bin. Community-aware threshold calibration reduced MSP OSCD relative to fixed 95% known recall on SYKE-ZooScan 2024 and SYKE-IFCB 2022; on ZooLake the fixed-recall baseline was already close to the community-aware threshold, and the best community-level method was a prototype-distance variant rather than MSP. The benefit of community-aware calibration therefore depends on validation-community representativeness and the gap between fixed recall and the community optimum. These results show that open-set plankton recognition should be evaluated as an ecological measurement problem, not only as a sample-level detection task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。