用迭代纠错法生成可调控的爵士即兴音乐,支持风格转换与补全。
ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement
- 通过自监督腐蚀-修复训练,实现风格可控的即兴生成。
- 在补全任务中优于AMT模型,79%用户能识别出古典曲的爵士版。
- 单模型支持跨/同风格即兴、配和声、短段补全,控制性强。
尽管深度学习在多个领域实现了显著进展,但在完整符号化音乐作品上实现可控的演奏级风格迁移仍具挑战性,主要受限于数据集匮乏(尤其是爵士类)及缺乏统一模型。本文提出ImprovNet,一种基于Transformer的架构,通过自监督腐蚀-修复训练策略生成富有表现力且可调控的音乐即兴。该方法旨在对原作的旋律、和声或节奏等元素进行有意义的风格化修改,以适配目标风格。ImprovNet统一了多项能力:支持跨风格与同风格即兴、按特定风格配和声、短段落续写与补全。其迭代生成框架允许用户调节风格迁移程度与原结构相似性。客观与主观评估表明,ImprovNet能生成音乐连贯的即兴,同时保持与原作的结构关联。在短段落续写与补全任务中表现优于预期音乐变压器(Anticipatory Music Transformer),且79%参与者正确识别出古典作品的爵士风格改编。代码与演示页面见https://github.com/keshavbhandari/improvnet。
原文摘要 · Abstract (English)
Despite deep learning's remarkable advances in style transfer across various domains, generating controllable performance-level musical style transfer for complete symbolically represented musical works remains a challenging area of research. Much of this is owed to limited datasets, especially for genres such as jazz, and the lack of unified models that can handle multiple music generation tasks. This paper presents ImprovNet, a transformer-based architecture that generates expressive and controllable musical improvisations through a self-supervised corruption-refinement training strategy. The improvisational style transfer is aimed at making meaningful modifications to one or more musical elements - melody, harmony or rhythm of the original composition with respect to the target genre. ImprovNet unifies multiple capabilities within a single model: it can perform cross-genre and intra-genre improvisations, harmonize melodies with genre-specific styles, and execute short prompt continuation and infilling tasks. The model's iterative generation framework allows users to control the degree of style transfer and structural similarity to the original composition. Objective and subjective evaluations demonstrate ImprovNet's effectiveness in generating musically coherent improvisations while maintaining structural relationships with the original pieces. The model outperforms Anticipatory Music Transformer in short continuation and infilling tasks and successfully achieves recognizable genre conversion, with 79\% of participants correctly identifying jazz-style improvisations of classical pieces. Our code and demo page can be found at https://github.com/keshavbhandari/improvnet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。