arXiv:2508.01752cs.CVcs.AI2025-08被引 6

用多摄像头视觉追踪奶牛行为,提升健康监测精度与效率。

Vision transformer-based multi-camera multi-object tracking framework for dairy cow monitoring

  • 融合全景拼接与改进的YOLO11-m检测模型,实现高精度识别
  • 采用SAMURAI分割与卡尔曼滤波,克服遮挡与姿态变化挑战
  • 在真实场景中实现98.7%以上MOTA,适合智能牧场长期监控

活动与行为与奶牛健康和福利密切相关,持续准确的监测对疾病识别和农场生产率至关重要。人工观察与频繁评估在活动监测中劳动强度大且结果不一致。本研究开发了一套针对圈养荷斯坦奶牛的多摄像头实时追踪系统。通过同伦变换几何对齐六路摄像头画面,构建集成式顶部全景图。检测阶段采用在俯视奶牛数据集上训练的优化版YOLO11-m模型,取得[email protected] = 0.97、F1 = 0.95的高精度。基于Segment Anything Model 2.1升级版SAMURAI,利用零样本学习与运动感知记忆生成像素级掩码,实现实例分割。结合运动感知线性卡尔曼滤波与基于交并比的数据关联,在遮挡与姿态变化下仍能可靠追踪目标。所提系统显著优于DeepSORT Realtime:在两个基准视频序列中,多目标追踪准确率(MOTA)分别为98.7%和99.3%,IDF1超过99%,身份切换接近零。该统一系统可实现在复杂室内环境中的实时奶牛追踪,减少重叠摄像头冗余检测,保持跨视角连续性,旨在通过行为量化与分类提升早期疾病预测能力。

原文摘要 · Abstract (English)

Activity and behaviour correlate with dairy cow health and welfare, making continual and accurate monitoring crucial for disease identification and farm productivity. Manual observation and frequent assessments are laborious and inconsistent for activity monitoring. In this study, we developed a unique multi-camera, real-time tracking system for indoor-housed Holstein Friesian dairy cows. This technology uses cutting-edge computer vision techniques, including instance segmentation and tracking algorithms to monitor cow activity seamlessly and accurately. An integrated top-down barn panorama was created by geometrically aligning six camera feeds using homographic transformations. The detection phase used a refined YOLO11-m model trained on an overhead cow dataset, obtaining high accuracy (mAP\@0.50 = 0.97, F1 = 0.95). SAMURAI, an upgraded Segment Anything Model 2.1, generated pixel-precise cow masks for instance segmentation utilizing zero-shot learning and motion-aware memory. Even with occlusion and fluctuating posture, a motion-aware Linear Kalman filter and IoU-based data association reliably identified cows over time for object tracking. The proposed system significantly outperformed Deep SORT Realtime. Multi-Object Tracking Accuracy (MOTA) was 98.7% and 99.3% in two benchmark video sequences, with IDF1 scores above 99% and near-zero identity switches. This unified multi-camera system can track dairy cows in complex interior surroundings in real time, according to our data. The system reduces redundant detections across overlapping cameras, maintains continuity as cows move between viewpoints, with the aim of improving early sickness prediction through activity quantification and behavioural classification.

多目标追踪视觉监控智能养殖视觉分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。