无需标注即可高效识别长视频中的动物个体,精度超97%。
Self-Supervised Animal Identification for Long Videos
- 将识别任务转为全局聚类,避免逐帧跟踪的误差累积。
- 在8头牛和鸽子数据集上达到97%以上准确率,仅需1GB显存。
- 适合资源受限的研究场景,可运行在消费级硬件上。
在长时间视频中识别个体动物对行为生态学、野生动物监测和畜牧管理至关重要。传统方法依赖大量人工标注,现有自监督方法计算开销大且因内存限制和时序误差传播,难以处理长序列。本文提出一种高效自监督方法,将动物识别重构为全局聚类任务而非序列追踪。该方法假设单个视频内个体数量已知(实际常见情形),仅需边界框检测和总数量。通过采样帧对,使用冻结预训练主干网络,并结合匈牙利算法实现批内伪标签分配的自举机制,学习判别性特征而无需身份标签。我们采用视觉-语言模型中的二元交叉熵损失,实现超过97%的准确率,每批仅消耗不到1GB GPU内存,较标准对比方法低一个数量级。在3D-POP鸽子与8头牛进食视频等真实数据集上,本框架表现媲美或超越在上千帧标注数据上训练的监督基线,有效消除人工标注瓶颈。该工作使高精度动物识别可在消费级硬件上实现,适用于资源受限的研究环境。所有代码见:https://huggingface.co/datasets/tonyFang04/8-calves。
原文摘要 · Abstract (English)
Identifying individual animals in long-duration videos is essential for behavioral ecology, wildlife monitoring, and livestock management. Traditional methods require extensive manual annotation, while existing self-supervised approaches are computationally demanding and ill-suited for long sequences due to memory constraints and temporal error propagation. We introduce a highly efficient, self-supervised method that reframes animal identification as a global clustering task rather than a sequential tracking problem. Our approach assumes a known, fixed number of individuals within a single video -- a common scenario in practice -- and requires only bounding box detections and the total count. By sampling pairs of frames, using a frozen pre-trained backbone, and employing a self-bootstrapping mechanism with the Hungarian algorithm for in-batch pseudo-label assignment, our method learns discriminative features without identity labels. We adapt a Binary Cross Entropy loss from vision-language models, enabling state-of-the-art accuracy ($>$97\%) while consuming less than 1 GB of GPU memory per batch -- an order of magnitude less than standard contrastive methods. Evaluated on challenging real-world datasets (3D-POP pigeons and 8-calves feeding videos), our framework matches or surpasses supervised baselines trained on over 1,000 labeled frames, effectively removing the manual annotation bottleneck. This work enables practical, high-accuracy animal identification on consumer-grade hardware, with broad applicability in resource-constrained research settings. All code written for this paper are \href{https://huggingface.co/datasets/tonyFang04/8-calves}{here}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。