用Conformer结构提升大词汇量和弦识别准确率。
ChordFormer: A Conformer-Based Architecture for Large-Vocabulary Audio Chord Recognition
- 采用卷积与注意力结合的Conformer块,捕捉音频的局部和全局特征。
- 在大词汇和弦数据集上,帧级准确率提升2%,类别级准确率提升6%。
- 适合需要高精度和弦识别的音乐分析与自动伴奏系统。
和弦识别是音乐信息检索中的关键任务,因其在音乐分析中具有抽象性和描述性。尽管小词汇量(如大小调)的音频和弦识别已取得显著进展,但大词汇量和弦识别仍面临挑战,尤其因和弦分布存在长尾现象,稀有和弦类型在多数数据集中样本不足,导致训练不充分。现有模型(如卷积神经网络、双向LSTM、双向Transformer组合)在捕捉长期依赖关系方面存在局限,难以胜任大词汇量任务。本文提出ChordFormer,一种基于Conformer架构的新模型,用于处理大词汇量下的结构化和弦识别(如三和弦、低音、七度和弦)。该模型通过融合卷积神经网络与变压器机制,有效捕捉局部模式与全局依赖。通过重加权损失函数缓解类别不平衡问题,并采用结构化和弦表示,ChordFormer在大词汇量和弦数据集上实现了2%的帧级准确率提升和6%的类别级准确率提升。此外,其对类别不平衡具有强鲁棒性,能在各类和弦间实现均衡识别。该方法将理论音乐知识与实际应用相结合,推动了大词汇量和弦识别领域的发展。
原文摘要 · Abstract (English)
Chord recognition serves as a critical task in music information retrieval due to the abstract and descriptive nature of chords in music analysis. While audio chord recognition systems have achieved significant accuracy for small vocabularies (e.g., major/minor chords), large-vocabulary chord recognition remains a challenging problem. This complexity also arises from the inherent long-tail distribution of chords, where rare chord types are underrepresented in most datasets, leading to insufficient training samples. Effective chord recognition requires leveraging contextual information from audio sequences, yet existing models, such as combinations of convolutional neural networks, bidirectional long short-term memory networks, and bidirectional transformers, face limitations in capturing long-term dependencies and exhibit suboptimal performance on large-vocabulary chord recognition tasks. This work proposes ChordFormer, a novel conformer-based architecture designed to tackle structural chord recognition (e.g., triads, bass, sevenths) for large vocabularies. ChordFormer leverages conformer blocks that integrate convolutional neural networks with transformers, thus enabling the model to capture both local patterns and global dependencies effectively. By addressing challenges such as class imbalance through a reweighted loss function and structured chord representations, ChordFormer outperforms state-of-the-art models, achieving a 2% improvement in frame-wise accuracy and a 6% increase in class-wise accuracy on large-vocabulary chord datasets. Furthermore, ChordFormer excels in handling class imbalance, providing robust and balanced recognition across chord types. This approach bridges the gap between theoretical music knowledge and practical applications, advancing the field of large-vocabulary chord recognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。