arXiv:2409.11264cs.SDcs.LG2024-09被引 7

用标签组合原型解决音乐音频少样本多标签识别问题

LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Tagging

  • 为每种标签组合生成原型,而非单个标签一个原型
  • 在多数数据集和设置下性能显著优于现有方法
  • 无需微调也能达到高水平,适合跨文化音乐分析

我们提出标签组合原型网络(LC-Protonets),用于解决多标签少样本分类问题,即模型需基于极少样本泛化到新类别。该方法扩展了原型网络,不再为每个标签生成一个原型,而是根据有限训练样本中出现的标签组合(来自标签的幂集)生成对应原型。将该方法应用于涵盖多种文化和传统与现代音乐的多个音乐数据集的自动音频标注任务,实验结果表明,在几乎所有领域和训练设置下,使用LC-Protonets进行多标签分类均取得显著性能提升。此外,我们还探索了利用监督预训练模型将样本嵌入特征空间的方法,微调可进一步提升泛化能力;但即使不微调,LC-Protonets仍能实现高水平表现,优于对比方法。最后,我们对所提方法的可扩展性进行了详细定量分析。代码与实验设置已公开,为未来研究提供基准。

原文摘要 · Abstract (English)

We introduce Label-Combination Prototypical Networks (LC-Protonets) to address the problem of multi-label few-shot classification, where a model must generalize to new classes based on only a few available examples. Extending Prototypical Networks, LC-Protonets generate one prototype per label combination, derived from the power set of labels present in the limited training items, rather than one prototype per label. Our method is applied to automatic audio tagging across diverse music datasets, covering various cultures and including both modern and traditional music, and is evaluated against existing approaches in the literature. The results demonstrate a significant performance improvement in almost all domains and training setups when using LC-Protonets for multi-label classification. In addition to training a few-shot learning model from scratch, we explore the use of a pre-trained model, obtained via supervised learning, to embed items in the feature space. Fine-tuning improves the generalization ability of all methods, yet LC-Protonets achieve high-level performance even without fine-tuning, in contrast to the comparative approaches. We finally analyze the scalability of the proposed method, providing detailed quantitative metrics from our experiments. The implementation and experimental setup are made publicly available, offering a benchmark for future research.

少样本学习音频标注多标签分类音乐分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。