提出可控制的旋律发展框架,让音乐生成既有长程结构又可修正偏差。
Yin-Yang: Developing Motifs With Long-Term Structure And Controllability
- 分三阶段生成:先构型、再修正、最后选段,实现可控旋律演化
- 新策略训练修正模型,能动态调整节奏与旋律偏差,提升整体一致性
- 支持半可解释结构,适合音乐创作与分析场景
Transformer 模型在生成具有局部连贯性的符号化音乐方面已取得显著进展,但在全局结构下对动机发展的可控性仍面临挑战。主要原因在于其逐音符自回归生成方式缺乏纠错能力,且现有研究未充分评估其在短时长数据集上的表现。本文提出 Yin-Yang 框架,包含片段生成器、片段修正器与片段选择器,实现动机向具有长程结构的旋律演化。修正器通过新型污染-修复训练策略,在生成时产生旋律与节奏的变体,有效纠正生成器的偏离。我们还引入新的客观评价指标,量化动机在乐曲中的自然呈现程度。实验表明,该模型在性能上优于当前最优 Transformer 模型,同时具备可控性与半可解释的音乐结构,为音乐分析提供新路径。代码与演示页面见 https://github.com/keshavbhandari/yinyang。
原文摘要 · Abstract (English)
Transformer models have made great strides in generating symbolically represented music with local coherence. However, controlling the development of motifs in a structured way with global form remains an open research area. One of the reasons for this challenge is due to the note-by-note autoregressive generation of such models, which lack the ability to correct themselves after deviations from the motif. In addition, their structural performance on datasets with shorter durations has not been studied in the literature. In this study, we propose Yin-Yang, a framework consisting of a phrase generator, phrase refiner, and phrase selector models for the development of motifs into melodies with long-term structure and controllability. The phrase refiner is trained on a novel corruption-refinement strategy which allows it to produce melodic and rhythmic variations of an original motif at generation time, thereby rectifying deviations of the phrase generator. We also introduce a new objective evaluation metric for quantifying how smoothly the motif manifests itself within the piece. Evaluation results show that our model achieves better performance compared to state-of-the-art transformer models while having the advantage of being controllable and making the generated musical structure semi-interpretable, paving the way for musical analysis. Our code and demo page can be found at https://github.com/keshavbhandari/yinyang.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。