自动推断MIDI演奏中的重复结构,提升乐谱与演奏对齐效率。
How to Infer Repeat Structures in MIDI Performances
- 基于局部对齐得分,通过候选结构拼接寻找最佳重复模式。
- 在真实演奏数据上实现90%以上的结构推断准确率。
- 适合音乐信息检索、演奏分析研究者使用。
MIDI演奏在表演研究和音乐信息检索中具有重要意义,尤其当其能与乐谱建立关联时。这种关联通常通过音符或时间点的对齐来实现。然而,演奏往往对应乐谱的多种可能结构版本,如重复、变奏和导航标记(如'dal segno/da capo al coda')。为进行对齐,需将乐谱展开为无跳转的单一时间线,但目前这一过程仍依赖人工,缺乏自动推断工具。本文提出一种方法,根据包含重复与导航标记的符号化乐谱,自动推断其对应的演奏重复结构。核心思想是:1)相同材料的连续段落对齐应获得高得分;2)符合演奏实际的结构版本在拼接局部对齐后,整体得分最高。实验表明,该方法在真实演奏数据上可实现超过90%的准确率。
原文摘要 · Abstract (English)
MIDI performances are generally expedient in performance research and music information retrieval, and even more so if they can be connected to a score. This connection is usually established by means of alignment, linking either notes or time points between the score and the performance. The first obstacle when trying to establish such an alignment is that a performance realizes one (out of many) structural versions of the score that can plausibly result from instructions such as repeats, variations, and navigation markers like 'dal segno/da capo al coda'. A score needs to be unfolded, that is, its repeats and navigation markers need to be explicitly written out to create a single timeline without jumps matching the performance, before alignment algorithms can be applied. In the curation of large performance corpora this process is carried out manually, as no tools are available to infer the repeat structure of the performance. To ease this process, we develop a method to automatically infer the repeat structure of a MIDI performance, given a symbolically encoded score including repeat and navigation markers. The intuition guiding our design is: 1) local alignment of every contiguous section of the score with a section of a performance containing the same material should receive high alignment gain, whereas local alignment with any other performance section should accrue a low or zero gain. And 2) stitching local alignments together according to a valid structural version of the score should result in an approximate full alignment and correspondingly high global accumulated gain if the structural version corresponds to the performance, and low gain for all other, ill-fitting structural versions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。