arXiv:2605.00225eess.AScs.LG2026-05被引 1

用通用声学模型识别大象叫声,无需标注数据也能接近顶尖效果。

From Birdsong to Rumbles: Classifying Elephant Calls with Out-of-Species Embeddings

论文配图:From Birdsong to Rumbles: Classifying Elephant Calls with Out-of-Species Embeddings
图 1 · 摘自论文原文
  • 用预训练声学嵌入+轻量分类器,不微调模型直接分类大象叫声。
  • Perch 2.0 在非洲象和亚洲象叫声上分别达到0.849和0.936的AUC。
  • 仅用第二层特征就能保持高精度,参数量减少至10%适合设备端运行。

我们证明,无需对嵌入模型进行微调,仅使用预训练的声学嵌入即可在接近端到端监督神经网络的水平上分类大象发声。该结果具有实际意义,因为生物声学标注数据稀缺且获取成本高,传统监督方法易过拟合,且在领域迁移下泛化能力差。评估了来自通用音频、语音和生物声学领域的多种嵌入模型,它们均未包含大象叫声数据或生物声学数据。嵌入网络保持固定,仅训练轻量级下游分类器(包括线性模型和多个小型神经网络)。在所考虑的模型中,Perch 2.0 表现最佳,跨验证分类性能达到非洲草原象(Loxodonta africana)AUC 0.849,亚洲象(Elephas maximus)AUC 0.936,Perch 1.0 紧随其后。最优系统性能比端到端监督系统低2.2%。对预训练Transformer编码器的逐层分析表明,中间层表示优于最终输出层。wav2vec2.0 和 HuBERT 的第二层编码已足够用于有效分类;截断至此层可保留分类性能,同时仅需全网络约10%的参数,适合计算资源受限的设备端处理。

原文摘要 · Abstract (English)

We show that pretrained acoustic embeddings classify elephant vocalisations at a level approaching that of end-to-end supervised neural networks, without any fine-tuning of the embedding model. This result is of practical importance because annotated bioacoustic data are scarce and costly to obtain, leaving conventional supervised approaches prone to overfitting and to poor generalisation under domain shift. A broad range of embedding models drawn from general audio, speech, and bioacoustic domains is evaluated, all of which are either out-of-domain (containing no bioacoustic data) or out-of-species (containing no elephant call data). The embedding networks themselves remain fixed; only the lightweight downstream classifiers, which include a linear model and several small neural networks, are trained. Among the models considered, Perch 2.0 achieves the best cross-validated classification performance, attaining AUCs of 0.849 on African bush elephant (Loxodonta africana) calls and 0.936 on Asian elephant (Elephas maximus) calls, with Perch 1.0 close behind. The best-performing system is within 2.2 % of an end-to-end supervised elephant call classification system. A layerwise analysis of pretrained transformer encoders, considered as embedding models, shows that intermediate representations outperform final-layer outputs. The second layer of both wav2vec2.0 and HuBERT encodes sufficient information for effective elephant call classification; truncation at this layer therefore preserves classification performance whilst retaining only approximately 10 % of the parameters of the full network. Such compact embedding networks are well suited to on-device processing where computational resources are limited.

生物声学嵌入模型大象叫声轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。