arXiv:2410.12695cs.CV2024-10被引 22

用多摄像头自监督学习实现奶牛精准识别,无需人工标注

Holstein-Friesian Re-Identification using Multiple Cameras and Self-Supervision on a Working Farm

  • 通过多摄像头采集图像,利用自监督学习识别奶牛个体
  • 单图识别准确率超96%,多视角数据提升识别效果
  • 适合智慧养殖、动物行为分析等农业场景

我们提出MultiCamCows2024,一个在实际奶牛场中通过三个吊装摄像头连续七天拍摄的大型图像数据集,用于基于黑白斑纹的荷斯坦牛个体生物特征识别。数据集包含90头牛的101,329张图像及原始CCTV视频。我们提供了完整的计算机视觉基线:基于牛轨迹片段的有监督与自监督学习框架。实验显示,单图识别准确率超过96%,且多摄像头数据联合训练可显著提升自监督识别性能。该框架可实现全自动牛只识别,仅需人工验证轨迹完整性。研究证明,多摄像头协同下的有监督与自监督方法不仅精度高,且无需人工标注身份,具备高效性。这对畜牧管理、行为分析与农业监测具有实际意义。为保障可复现性与实用性,相关代码、重识别模块及物种检测器均已开源,地址见https://tinyurl.com/MultiCamCows2024。

原文摘要 · Abstract (English)

We present MultiCamCows2024, a farm-scale image dataset filmed across multiple cameras for the biometric identification of individual Holstein-Friesian cattle exploiting their unique black and white coat-patterns. Captured by three ceiling-mounted visual sensors covering adjacent barn areas over seven days on a working dairy farm, the dataset comprises 101,329 images of 90 cows, plus underlying original CCTV footage. The dataset is provided with full computer vision recognition baselines, that is both a supervised and self-supervised learning framework for individual cow identification trained on cattle tracklets. We report a performance above 96% single image identification accuracy from the dataset and demonstrate that combining data from multiple cameras during learning enhances self-supervised identification. We show that our framework enables automatic cattle identification, barring only the simple human verification of tracklet integrity during data collection. Crucially, our study highlights that multi-camera, supervised and self-supervised components in tandem not only deliver highly accurate individual cow identification, but also achieve this efficiently with no labelling of cattle identities by humans. We argue that this improvement in efficacy has practical implications for livestock management, behaviour analysis, and agricultural monitoring. For reproducibility and practical ease of use, we publish all key software and code including re-identification components and the species detector with this paper, available at https://tinyurl.com/MultiCamCows2024.

牛识别自监督农业AI多摄像头

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。