将音乐符号还原为可执行代码,让机器理解音乐创作逻辑。
Decomposer: Learning to Decompile Symbolic Music to Programs

- 用合成数据训练模型,从MIDI生成可读的音乐程序
- 通过强化学习提升代码可读性与演奏还原度
- 适合音乐编程、智能作曲与算法作曲研究者
音乐表演本质上是执行一系列高层音乐指令,但从中逆向恢复这些指令是一个挑战性的逆问题。我们提出Decomposer,一个面向符号化音乐反编译的后训练框架:即从符号化音乐中恢复出可执行、可编辑的音乐程序。我们将任务定义为MIDI到Strudel的反编译,模型输入符号化MIDI,输出在Strudel语言中可执行的程序,执行后能重建原始输入。该任务面临两大挑战:Strudel是一种低资源语言,缺乏自然配对的MIDI-代码数据;仅优化MIDI还原度会导致生成冗长且不可读的逐音符翻译。为此我们分两阶段解决:首先构建Strudel-Synth,一个包含合成的Strudel程序与对应渲染MIDI的语料库,并用于监督微调;其次利用无配对的MIDI数据进行强化学习,优化同时兼顾MIDI还原忠实度与代码可读性的奖励函数。在合成与真实世界MIDI基准上的评估表明,Decomposer在音乐还原度上显著优于闭源大模型,且生成的代码更具可读性和多样性。
原文摘要 · Abstract (English)
Musical performance involves executing a set of high-level musical instructions, yet recovering those instructions from the performance is a challenging inverse problem. We present Decomposer, a post-training framework for symbolic music decompilation: the task of recovering executable, editable music programs from symbolic music. We instantiate the task as MIDI-to-Strudel decompilation, where the model takes symbolic MIDI as input and produces a program in Strudel, a music programming language, that reconstructs the input when executed. The task poses two challenges: Strudel is a low-resource language with little naturally paired MIDI-code data, and optimizing faithful reconstruction of MIDI alone can collapse to unreadable note-by-note transliteration. We address these challenges in two stages. First, we construct Strudel-Synth, a synthetic corpus of paired Strudel programs and rendered MIDI, and use it for supervised fine-tuning. Second, we refine the model with reinforcement learning on unpaired MIDI, optimizing rewards for both MIDI reconstruction faithfulness and code readability. Our evaluation across synthetic and real-world MIDI benchmarks shows that Decomposer achieves substantially higher MIDI reconstruction faithfulness than closed-source LLMs while producing more readable and diverse code than the heuristic converter.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。