arXiv:2409.11753cs.SDeess.AS2024-09IJCAI被引 6

用Transformer VAE实现旋律感知的可控配器生成,支持分小节和音轨级控制。

METEOR: Melody-aware Texture-controllable Symbolic Orchestral Music Generation via Transformer VAE

  • 基于Transformer VAE架构,实现旋律忠实与纹理可控的符号化配器生成
  • 在配器任务中优于现有风格迁移模型,主观与客观评估均表现更优
  • 零样本适配至主旋律配器任务,性能媲美专用训练模型

配器是将乐曲改编为不同乐器组合的过程。通过改变原作的乐器配置,编配者通常会调整音乐织体,同时保持可辨识的旋律线,并确保各声部在所选乐器的技术与表现力范围内可演奏。本文提出METEOR,一种基于Transformer变分自编码器(VAE)的旋律感知、纹理可控的符号化配器生成模型。该模型专注于旋律保真度与控制性,支持在小节级和音轨级对伴奏纹理进行多种属性控制,同时维持同音程织体结构。通过主观与客观评估,我们证明该模型在配器任务中的生成质量与可控性方面均优于现有风格迁移模型。此外,其可作为零样本学习模型用于主旋律配器任务,性能达到专门训练模型的水平。

原文摘要 · Abstract (English)

Re-orchestration is the process of adapting a music piece for a different set of instruments. By altering the original instrumentation, the orchestrator often modifies the musical texture while preserving a recognizable melodic line and ensures that each part is playable within the technical and expressive capabilities of the chosen instruments. In this work, we propose METEOR, a model for generating Melody-aware Texture-controllable re-Orchestration with a Transformer-based variational auto-encoder (VAE). This model performs symbolic instrumental and textural music style transfers with a focus on melodic fidelity and controllability. We allow bar- and track-level controllability of the accompaniment with various textural attributes while keeping a homophonic texture. With both subjective and objective evaluations, we show that our model outperforms style transfer models on a re-orchestration task in terms of generation quality and controllability. Moreover, it can be adapted for a lead sheet orchestration task as a zero-shot learning model, achieving performance comparable to a model specifically trained for this task.

配器生成可控生成符号音乐Transformer VAE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。