为吉他节奏模式构建可读的自动转录系统,适合音乐研究与创作。
Transcribing Rhythmic Patterns of the Guitar Track in Polyphonic Music
- 分三步:分离吉他声部、检测扫弦、用专家词典解码节奏模式
- 在410首流行歌上实现高精度转录,含自动节拍线与调式标记
- 提供可读节奏表示,适合音乐分析与智能作曲应用
尽管和弦转录已有大量研究,但歌曲中反复出现的吉他节奏模式转录仍较少被关注。针对节奏吉他常以重复与变化的扫弦模式演奏的特点,本文提出一个三步框架:首先通过近似音源分离提取吉他部分;其次利用预训练模型MERT检测分离后音频中的单个扫弦;最后将扫弦序列转化为专家定制词汇表中的节奏模式。为建立有明确标注的基准数据集,我们邀请专业音乐人转录410首流行歌曲的节奏模式,并录制遵循这些转录的翻唱版本。实验表明,该方法能高精度转录多声部音乐中的吉他节奏模式,生成人类可读的表示,包含自动识别的条线与拍号标记。通过消融实验与错误分析,提出一套评估预测节奏序列准确性和可读性的指标。
原文摘要 · Abstract (English)
Whereas chord transcription has received considerable attention during the past couple of decades, far less work has been devoted to transcribing and encoding the rhythmic patterns that occur in a song. The topic is especially relevant for instruments such as the rhythm guitar, which is typically played by strumming rhythmic patterns that repeat and vary over time. However, in many cases one cannot objectively define a single "right" rhythmic pattern for a given song section. To create a dataset with well-defined ground-truth labels, we asked expert musicians to transcribe the rhythmic patterns in 410 popular songs and record cover versions where the guitar tracks followed those transcriptions. To transcribe the strums and their corresponding rhythmic patterns, we propose a three-step framework. Firstly, we perform approximate stem separation to extract the guitar part from the polyphonic mixture. Secondly, we detect individual strums within the separated guitar audio, using a pre-trained foundation model (MERT) as a backbone. Finally, we carry out a pattern-decoding process in which the transcribed sequence of guitar strums is represented by patterns drawn from an expert-curated vocabulary. We show that it is possible to transcribe the rhythmic patterns of the guitar track in polyphonic music with quite high accuracy, producing a representation that is human-readable and includes automatically detected bar lines and time signature markers. We perform ablation studies and error analysis and propose a set of evaluation metrics to assess the accuracy and readability of the predicted rhythmic pattern sequence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。