arXiv:2412.05602cs.CV2024-12被引 27

用跨物种数据训练统一动物识别模型,性能优于单物种模型。

Multispecies Animal Re-ID Using a Large Community-Curated Dataset

  • 构建包含49种、3.7万只动物的跨物种数据集,用EfficientNetV2+动态边距ArcFace训练统一模型。
  • 在33个未见物种上平均提升19.2%识别准确率,零样本与微调能力突出。
  • 适合需要快速扩展物种识别能力的野生动物监测项目使用。

近期研究强调了从图像中识别个体动物在生态学中的重要性。传统方法为每种动物单独训练模型,但成本高、数据少且无法利用物种间共性。本文提出一种多物种个体识别模型,构建涵盖49个物种、3.7万只动物、22.5万张图像的数据集,采用EfficientNetV2骨干网络与子中心ArcFace损失函数(动态边距)训练统一嵌入网络。评估显示,该模型在多数场景下超越单物种模型,平均提升12.5%的Top-1准确率;在未见物种上表现更优,平均提升19.2%(33个物种测试),并具备良好的零样本与微调能力。代码与模型已开源,支持在60多个物种的大型野生动物监测系统中部署。

原文摘要 · Abstract (English)

Recent work has established the ecological importance of developing algorithms for identifying animals individually from images. Typically, a separate algorithm is trained for each species, a natural step but one that creates significant barriers to wide-spread use: (1) each effort is expensive, requiring data collection, data curation, and model training, deployment, and maintenance, (2) there is little training data for many species, and (3) commonalities in appearance across species are not exploited. We propose an alternative approach focused on training multi-species individual identification (re-id) models. We construct a dataset that includes 49 species, 37K individual animals, and 225K images, using this data to train a single embedding network for all species. Our model employs an EfficientNetV2 backbone and a sub-center ArcFace loss function with dynamic margins. We evaluate the performance of this multispecies model in several ways. Most notably, we demonstrate that it consistently outperforms models trained separately on each species, achieving an average gain of 12.5% in top-1 accuracy. Furthermore, the model demonstrates strong zero-shot performance and fine-tuning capabilities for new species with limited training data, enabling effective curation of new species through both incremental addition of data to the training set and fine-tuning without the original data. Additionally, our model surpasses the recent MegaDescriptor on unseen species, averaging an 19.2% top-1 improvement per species and showing gains across all 33 species tested. The fully-featured code repository is publicly available on GitHub, and the feature extractor model can be accessed on HuggingFace for seamless integration with wildlife re-identification pipelines. The model is already in production use for 60+ species in a large-scale wildlife monitoring system.

动物识别多物种零样本生态监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。