跨物种动物行为识别新框架,提升小样本场景下的准确率
CKSP: Cross-species Knowledge Sharing and Preserving for Universal Animal Activity Recognition
- 设计共享-保留卷积模块,同时学习共性与特异性行为特征
- 在马、羊、牛数据集上准确率提升6.04%~3.66%,F1-score提升7.90%~10.33%
- 适合缺乏标注数据的多物种动物行为分析场景
深度学习在穿戴式传感器的动物行为识别(AAR)任务中表现优异,但现有模型仅基于单一物种数据训练,限制了实际应用,尤其在数据稀缺时表现差。本文提出一种一统多物种的框架CKSP,利用多种动物的传感器数据。针对不同物种间既有通用又有特异的行为模式,设计共享-保留卷积(SPConv)模块:为每种动物分配独立低秩卷积层提取特异性特征,同时使用共享全秩卷积层学习通用特征,实现跨物种互补性学习并缓解数据不足问题。考虑到物种间数据分布差异导致的训练冲突,引入物种特异性批量归一化(SBN)模块,采用多个批归一化层分别适配各物种分布。在马、羊、牛三个公开数据集上的实验表明,相比仅针对单物种训练的基线方法,本方法在准确率上分别提升6.04%、2.06%和3.66%,F1-score分别提升10.33%、3.67%和7.90%,证明其通过多物种数据增强分类性能的潜力。
原文摘要 · Abstract (English)
Deep learning techniques are dominating automated animal activity recognition (AAR) tasks with wearable sensors due to their high performance on large-scale labelled data. However, current deep learning-based AAR models are trained solely on datasets of individual animal species, constraining their applicability in practice and performing poorly when training data are limited. In this study, we propose a one-for-many framework, dubbed Cross-species Knowledge Sharing and Preserving (CKSP), based on sensor data of diverse animal species. Given the coexistence of generic and species-specific behavioural patterns among different species, we design a Shared-Preserved Convolution (SPConv) module. This module assigns an individual low-rank convolutional layer to each species for extracting species-specific features and employs a shared full-rank convolutional layer to learn generic features, enabling the CKSP framework to learn inter-species complementarity and alleviating data limitations via increasing data diversity. Considering the training conflict arising from discrepancies in data distributions among species, we devise a Species-specific Batch Normalization (SBN) module, that involves multiple BN layers to separately fit the distributions of different species. To validate CKSP's effectiveness, experiments are performed on three public datasets from horses, sheep, and cattle, respectively. The results show that our approach remarkably boosts the classification performance compared to the baseline method (one-for-one framework) solely trained on individual-species data, with increments of 6.04%, 2.06%, and 3.66% in accuracy, and 10.33%, 3.67%, and 7.90% in F1-score for the horse, sheep, and cattle datasets, respectively. This proves the promising capabilities of our method in leveraging multi-species data to augment classification performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。