arXiv:2410.08626cs.SDeess.AS2024-10中稿 · 31st International…被引 3

用骨架音符条件生成中国传统小调,提升旋律结构质量。

Small Tunes Transformer: Exploring Macro & Micro-Level Hierarchies for Skeleton-Conditioned Melody Generation

  • 从宏观乐句与微观骨架音双重层次建模音乐结构
  • 在10088首小调数据集上超越现有模型,生成更优旋律
  • 专为中文民歌设计,适合传统音乐生成研究者

近年来,符号化音乐生成成为深度学习研究热点。结构是提升音乐质量的关键因素,越来越多工作开始关注音乐的层次结构。本文从宏观与微观两个层面探索音乐的多层级结构:在宏观层面,通过乐句分割算法分析乐句对音乐整体发展的影响;在微观层面,设计骨架音提取策略,研究每个乐句内骨架音如何引导旋律生成。同时提出一种新的乐句级交叉注意力机制,捕捉宏观与微观结构间的内在关联。针对当前中文风格音乐研究不足,构建了小型曲调数据集(Small Tunes Dataset),包含10088个传统中国民歌曲目MIDI文件。以提取的骨架音作为条件生成小调,实验表明所提出的Small Tunes Transformer模型优于其他先进模型。此外,设计三种新评价指标,从节奏与旋律维度评估生成音乐质量。

原文摘要 · Abstract (English)

Recently, symbolic music generation has become a focus of numerous deep learning research. Structure as an important part of music, contributes to improving the quality of music, and an increasing number of works start to study the hierarchical structure. In this study, we delve into the multi-level structures within music from macro-level and micro-level hierarchies. At the macro-level hierarchy, we conduct phrase segmentation algorithm to explore how phrases influence the overall development of music, and at the micro-level hierarchy, we design skeleton notes extraction strategy to explore how skeleton notes within each phrase guide the melody generation. Furthermore, we propose a novel Phrase-level Cross-Attention mechanism to capture the intrinsic relationship between macro-level hierarchy and micro-level hierarchy. Moreover, in response to the current lack of research on Chinese-style music, we construct our Small Tunes Dataset: a substantial collection of MIDI files comprising 10088 Small Tunes, a category of traditional Chinese Folk Songs. This dataset serves as the focus of our study. We generate Small Tunes songs utilizing the extracted skeleton notes as conditions, and experiment results indicate that our proposed model, Small Tunes Transformer, outperforms other state-of-the-art models. Besides, we design three novel objective evaluation metrics to evaluate music from both rhythm and melody dimensions.

音乐生成骨架音中文民歌层次结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。