用视频直接识别牛跛行,准确率达90%,无需复杂预处理。
Direct Video-Based Spatiotemporal Deep Learning for Cattle Lameness Detection
- 直接用视频做端到端分类,跳过姿态估计等中间步骤。
- 3D CNN模型在50段视频上达90%准确率,各项指标均超90%。
- 公开了42头牛的多视角视频数据集,适合农业AI研究者使用。
牛跛行是畜牧业中普遍存在的健康问题,常由蹄部损伤或感染引起,严重影响动物福利与生产效率。早期精准检测对减少经济损失和及时治疗至关重要。本文提出一种基于公开视频数据的时空深度学习框架,实现自动化牛跛行检测。研究构建并公开了一个包含50段视频、42头牛的平衡数据集,涵盖室内外多种视角。视频依据步态特征和元数据分为跛行与非跛行两类。经数据增强后,训练并评估了3D卷积神经网络(3D CNN)与卷积长短期记忆(ConvLSTM2D)两种架构。3D CNN在视频级分类中达到90%准确率,精确率、召回率与F1分数均为90.9%,优于ConvLSTM2D的85%准确率。该方法无需依赖目标检测与姿态估计的多阶段流程,相较最佳已有端到端方法(C3D-ConvLSTM,90.3%),精度相当但省去姿态估计预处理。结果表明,深度学习可有效从多源视频中提取时空特征,实现在真实农场环境中的可扩展、高效跛行检测。
原文摘要 · Abstract (English)
Cattle lameness is a prevalent health problem in livestock farming, often resulting from hoof injuries or infections, and severely impacts animal welfare and productivity. Early and accurate detection is critical for minimizing economic losses and ensuring proper treatment. This study proposes a spatiotemporal deep learning framework for automated cattle lameness detection using publicly available video data. We curate and publicly release a balanced set of 50 online video clips featuring 42 individual cattle, recorded from multiple viewpoints in both indoor and outdoor environments. The videos were categorized into lame and non-lame classes based on visual gait characteristics and metadata descriptions. After applying data augmentation techniques to enhance generalization, two deep learning architectures were trained and evaluated: 3D Convolutional Neural Networks (3D CNN) and Convolutional Long-Short-Term Memory (ConvLSTM2D). The 3D CNN achieved a video-level classification accuracy of 90%, with a precision, recall, and F1 score of 90.9% each, outperforming the ConvLSTM2D model, which achieved 85% accuracy. Unlike conventional approaches that rely on multistage pipelines involving object detection and pose estimation, this study demonstrates the effectiveness of a direct end-to-end video classification approach. Compared with the best end-to-end prior method (C3D-ConvLSTM, 90.3%), our model achieves comparable accuracy while eliminating pose estimation pre-processing.The results indicate that deep learning models can successfully extract and learn spatio-temporal features from various video sources, enabling scalable and efficient cattle lameness detection in real-world farm settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。