arXiv:2505.10198cs.LG2025-05被引 8

用声音和运动信号融合识别牛采食行为,准确率提升14%

A multi-head deep fusion model for recognition of cattle foraging events using sound and movement signals

  • 采用卷积-循环-全连接网络融合声学与惯性信号
  • 特征级融合使F1得分达0.802,较此前方法提升14%
  • 适合畜牧智能监测与动物健康早期预警场景

监控采食行为对高效牧场管理与资源利用至关重要。通过识别特定颚部运动自动判断牛的采食活动,有助于优化饲料配方、早期发现代谢问题及动物不适。近二十年来,加速度计、麦克风和摄像头等传感器被广泛用于此类监测,各有优劣。本文首次探索多传感器协同,提出一种基于声学与惯性信号融合的深度神经网络模型,包含卷积、循环和全连接层。该模型通过自动提取各信号独立特征实现融合。经多架构比较,特征级融合在F1-score上优于数据与决策级融合至少0.14。与当前先进机器学习方法对比,本模型取得0.802的F1-score,相比之前方法提升14%。还报告了消融实验与后训练量化评估结果。

原文摘要 · Abstract (English)

Monitoring feeding behaviour is a relevant task for efficient herd management and the effective use of available resources in grazing cattle. The ability to automatically recognise animals' feeding activities through the identification of specific jaw movements allows for the improvement of diet formulation, as well as early detection of metabolic problems and symptoms of animal discomfort, among other benefits. The use of sensors to obtain signals for such monitoring has become popular in the last two decades. The most frequently employed sensors include accelerometers, microphones, and cameras, each with its own set of advantages and drawbacks. An unexplored aspect is the simultaneous use of multiple sensors with the aim of combining signals in order to enhance the precision of the estimations. In this direction, this work introduces a deep neural network based on the fusion of acoustic and inertial signals, composed of convolutional, recurrent, and dense layers. The main advantage of this model is the combination of signals through the automatic extraction of features independently from each of them. The model has emerged from an exploration and comparison of different neural network architectures proposed in this work, which carry out information fusion at different levels. Feature-level fusion has outperformed data and decision-level fusion by at least a 0.14 based on the F1-score metric. Moreover, a comparison with state-of-the-art machine learning methods is presented, including traditional and deep learning approaches. The proposed model yielded an F1-score value of 0.802, representing a 14% increase compared to previous methods. Finally, results from an ablation study and post-training quantization evaluation are also reported.

动物行为识别多模态融合深度学习智能畜牧

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。