用少量标注数据实现长尾音乐标签自动识别,提升标签扩展能力。
Music auto-tagging in the long tail: A few-shot approach
- 用预训练特征+轻量线性分类器,实现少样本音乐标签生成
- 仅需每标签20个样本,性能接近顶尖模型
- 适合标签稀疏场景,尤其适用于新标签快速部署
在数字音乐领域,使用标签高效组织和检索海量音乐数据库对唱片库管理者至关重要。人工标注准确但耗时,而传统监督学习虽准确却受限于预定义标签集。少样本学习可通过极少人类标注样例,让模型理解标签含义并自主应用。本文将少样本学习引入多标签音乐自动标注,采用预训练模型特征作为输入,搭配轻量级线性分类器(即线性探针)。我们测试了多种主流预训练特征及不同少样本参数设置。实验表明,该简单模型在仅20个样本/标签的条件下,性能接近当前最优模型;且在全量数据训练下,线性探针表现可与领先模型比肩。结果验证了基于迁移学习的少样本方法能有效应对仅有少量标注数据时的长尾标签自动分配问题。
原文摘要 · Abstract (English)
In the realm of digital music, using tags to efficiently organize and retrieve music from extensive databases is crucial for music catalog owners. Human tagging by experts is labor-intensive but mostly accurate, whereas automatic tagging through supervised learning has approached satisfying accuracy but is restricted to a predefined set of training tags. Few-shot learning offers a viable solution to expand beyond this small set of predefined tags by enabling models to learn from only a few human-provided examples to understand tag meanings and subsequently apply these tags autonomously. We propose to integrate few-shot learning methodology into multi-label music auto-tagging by using features from pre-trained models as inputs to a lightweight linear classifier, also known as a linear probe. We investigate different popular pre-trained features, as well as different few-shot parametrizations with varying numbers of classes and samples per class. Our experiments demonstrate that a simple model with pre-trained features can achieve performance close to state-of-the-art models while using significantly less training data, such as 20 samples per tag. Additionally, our linear probe performs competitively with leading models when trained on the entire training dataset. The results show that this transfer learning-based few-shot approach could effectively address the issue of automatically assigning long-tail tags with only limited labeled data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。