构建13类猪行为数据集,用注意力机制提升行为识别准确率。
Pig behavior dataset and Spatial-temporal perception and enhancement networks based on the attention mechanism for pig behavior recognition
- 基于注意力机制设计时空感知与增强网络,捕捉猪行为的时空特征。
- 在自建数据集上达到75.92%的MAP,比最优传统模型提升8.17%。
- 适合智能养猪、动物行为分析及计算机视觉研究者参考。
猪行为识别在智慧农业与猪只福利保障中至关重要。当前该领域缺乏公开的行为数据集,限制了创新算法发展并影响模型鲁棒性与优化。本文提出一个包含13类影响福利的猪行为数据集,并基于此构建一种基于注意力机制的时空感知与增强网络,以建模视频数据中猪行为的时空特征及其关联区域。该网络由时空感知网络和时空特征增强网络组成:前者建立猪与行为关键区域的联系,后者通过重构建连接,强化个体空间特征并捕捉行为的长期依赖关系,从而提升对行为时空变化的感知能力。实验结果表明,在本研究所建数据集上,所提模型取得75.92%的MAP,较最优传统模型提升8.17%。本研究不仅提升了个体猪行为识别的准确性与泛化能力,也为现代智慧农业提供了新工具。数据集与代码将随论文公开。
原文摘要 · Abstract (English)
The recognition of pig behavior plays a crucial role in smart farming and welfare assurance for pigs. Currently, in the field of pig behavior recognition, the lack of publicly available behavioral datasets not only limits the development of innovative algorithms but also hampers model robustness and algorithm optimization.This paper proposes a dataset containing 13 pig behaviors that significantly impact welfare.Based on this dataset, this paper proposes a spatial-temporal perception and enhancement networks based on the attention mechanism to model the spatiotemporal features of pig behaviors and their associated interaction areas in video data. The network is composed of a spatiotemporal perception network and a spatiotemporal feature enhancement network. The spatiotemporal perception network is responsible for establishing connections between the pigs and the key regions of their behaviors in the video data. The spatiotemporal feature enhancement network further strengthens the important spatial features of individual pigs and captures the long-term dependencies of the spatiotemporal features of individual behaviors by remodeling these connections, thereby enhancing the model's perception of spatiotemporal changes in pig behaviors. Experimental results demonstrate that on the dataset established in this paper, our proposed model achieves a MAP score of 75.92%, which is an 8.17% improvement over the best-performing traditional model. This study not only improces the accuracy and generalizability of individual pig behavior recognition but also provides new technological tools for modern smart farming. The dataset and related code will be made publicly available alongside this paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。