针对动物行为识别中采样率与类别不平衡问题,提出自适应特征融合与分类器校准方法。
Toward Optimal Sampling Rate Selection and Unbiased Classification for Precise Animal Activity Recognition
- 基于多专家架构,自适应融合多采样率数据以提取行为特异性特征
- 在三个公开数据集上,对所有行为类别的准确率均显著提升,最高达96.7%
- 适合需要高精度细分行为识别的畜牧管理与动物福利监测场景
随着深度学习的发展,可穿戴传感器辅助的动物活动识别(AAR)展现出良好性能,有助于提升畜牧管理效率及动物健康与福利监测。然而,现有研究常忽视特定行为类别的识别精度,这通常源于采样率不当或类别不平衡问题。为解决这些问题并实现农场动物各类行为的高精度识别,本文提出个体行为感知网络(IBA-Net)。该网络通过同时定制特征和校准分类器,增强对每种具体行为的识别能力。具体而言,考虑到不同行为需不同采样率以达最优表现,设计了基于混合专家(MoE)的特征定制(MFC)模块,自适应融合多采样率数据,捕捉行为特异性特征。此外,为缓解因类别不平衡导致的分类器偏向多数类问题,开发了由神经坍缩驱动的分类器校准(NC3)模块。该模块在分类阶段引入固定等角紧框架(ETF)分类器,最大化类别向量间的夹角,从而提升少数类识别效果。在涵盖山羊、牛和马活动识别的三个公共数据集上验证了IBA-Net的有效性。结果表明,该方法在所有数据集上均持续优于现有方法。
原文摘要 · Abstract (English)
With the rapid advancements in deep learning techniques, wearable sensor-aided animal activity recognition (AAR) has demonstrated promising performance, thereby improving livestock management efficiency as well as animal health and welfare monitoring. However, existing research often prioritizes overall performance, overlooking the fact that classification accuracies for specific animal behavioral categories may remain unsatisfactory. This issue typically stems from suboptimal sampling rates or class imbalance problems. To address these challenges and achieve high classification accuracy across all individual behaviors in farm animals, we propose a novel Individual-Behavior-Aware Network (IBA-Net). This network enhances the recognition of each specific behavior by simultaneously customizing features and calibrating the classifier. Specifically, considering that different behaviors require varying sampling rates to achieve optimal performance, we design a Mixture-of-Experts (MoE)-based Feature Customization (MFC) module. This module adaptively fuses data from multiple sampling rates, capturing customized features tailored to various animal behaviors. Additionally, to mitigate classifier bias toward majority classes caused by class imbalance, we develop a Neural Collapse-driven Classifier Calibration (NC3) module. This module introduces a fixed equiangular tight frame (ETF) classifier during the classification stage, maximizing the angles between pair-wise classifier vectors and thereby improving the classification performance for minority classes. To validate the effectiveness of IBA-Net, we conducted experiments on three public datasets covering goat, cattle, and horse activity recognition. The results demonstrate that our method consistently outperforms existing approaches across all datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。