用深度学习重做印度卡纳提克音乐的节拍追踪,效果优于传统方法。
Revisiting Meter Tracking in Carnatic Music using Deep Learning Approaches
- 用TCN和Beat This!两个深度模型,在相同条件下测试节拍追踪性能。
- 迁移学习后模型表现超越传统概率模型,准确率显著提升。
- 适合研究小众音乐传统或跨文化音乐信息检索的学者。
节拍与强拍追踪(统称节拍追踪)是音乐信息检索中的基础任务。深度学习模型在西方音乐领域已远超传统方法,尤其依赖大规模标注数据。但在代表性不足的音乐传统中表现不佳。卡纳提克音乐源自南印度,以复杂的节奏结构(塔拉)著称。此前最佳工作采用动态贝叶斯网络(DBN)。本文评估两种模型在卡纳提克音乐中的表现:轻量级时序卷积网络(TCN)和基于Transformer的Beat This!。在相同的CMR$_f$数据集实验设置下,系统比较其性能,并探索微调及音乐先验参数的适应策略。结果显示,虽即插即用模型未必胜过DBN,但经迁移学习后性能大幅提升,可达到或超过基线。表明当前先进深度模型可有效适配非主流音乐传统,推动更具包容性的节拍追踪系统发展。
原文摘要 · Abstract (English)
Beat and downbeat tracking, jointly referred to as Meter Tracking, is a fundamental task in Music Information Retrieval (MIR). Deep learning models have far surpassed traditional signal processing and classical machine learning approaches in this domain, particularly for Western (Eurogenetic) genres, where large annotated datasets are widely available. These systems, however, perform less reliably on underrepresented musical traditions. Carnatic music, a rich tradition from the Indian subcontinent, is renowned for its rhythmic intricacy and unique metrical structures (tālas). The most notable prior work on meter tracking in this context employed probabilistic Dynamic Bayesian Networks (DBNs). The performance of state-of-the-art (SOTA) deep learning models on Carnatic music, however, remains largely unexplored. In this study, we evaluate two models for meter tracking in Carnatic music: the Temporal Convolutional Network (TCN), a lightweight architecture that has been successfully adapted for Latin rhythms, and Beat This!, a transformer-based model designed for broad stylistic coverage without the need for post-processing. Replicating the experimental setup of the DBN baseline on the Carnatic Music Rhythm (CMR$_f$) dataset, we systematically assess the performance of these models in a directly comparable setting. We further investigate adaptation strategies, including fine-tuning the models on Carnatic data and the use of musically informed parameters. Results show that while off-the-shelf models do not always outperform the DBN, their performance improves substantially with transfer learning, matching or surpassing the baseline. These findings indicate that SOTA deep learning models can be effectively adapted to underrepresented traditions, paving the way for more inclusive and broadly applicable meter tracking systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。