构建真实猪场挑战场景下的检测与追踪基准数据集,提升自动化畜牧监控性能。
Benchmarking pig detection and tracking under diverse and challenging conditions
- 构建两个真实猪场数据集:PigDetect(检测)和PigTrack(追踪)
- 基于挑战性场景训练的模型检测精度显著优于随机采样数据
- 端到端模型追踪关联表现更优,适合未来改进应用
为保障养猪业动物福利与高效管理,个体行为监测至关重要。传统人工监测正被机器学习驱动的自动化方法取代,核心在于空间(目标检测)与时间(多目标追踪)中的动物定位。尽管相关研究丰富,但缺乏系统性基准评估。本文构建了两个数据集:基于真实猪舍图像与视频的PigDetect(目标检测)与PigTrack(多目标追踪),涵盖遮挡、低可见度等挑战场景。实验表明,使用挑战性训练图像可显著提升检测性能;最先进的模型在检测质量上远超实时方案。追踪方面,SORT类方法检测表现更优,而端到端模型关联性能更佳,暗示其未来潜力。我们还分析了端到端模型典型失败案例,为后续改进提供指导。在未见猪栏中模型表现良好,体现强泛化能力,凸显高质量训练数据的重要性。所有数据与代码公开,支持复现与进一步开发。
原文摘要 · Abstract (English)
To ensure animal welfare and effective management in pig farming, monitoring individual behavior is a crucial prerequisite. While monitoring tasks have traditionally been carried out manually, advances in machine learning have made it possible to collect individualized information in an increasingly automated way. Central to these methods is the localization of animals across space (object detection) and time (multi-object tracking). Despite extensive research of these two tasks in pig farming, a systematic benchmarking study has not yet been conducted. In this work, we address this gap by curating two datasets: PigDetect for object detection and PigTrack for multi-object tracking. The datasets are based on diverse image and video material from realistic barn conditions, and include challenging scenarios such as occlusions or bad visibility. For object detection, we show that challenging training images improve detection performance beyond what is achievable with randomly sampled images alone. Comparing different approaches, we found that state-of-the-art models offer substantial improvements in detection quality over real-time alternatives. For multi-object tracking, we observed that SORT-based methods achieve superior detection performance compared to end-to-end trainable models. However, end-to-end models show better association performance, suggesting they could become strong alternatives in the future. We also investigate characteristic failure cases of end-to-end models, providing guidance for future improvements. The detection and tracking models trained on our datasets perform well in unseen pens, suggesting good generalization capabilities. This highlights the importance of high-quality training data. The datasets and research code are made publicly available to facilitate reproducibility, re-use and further development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。