arXiv:2508.20665cs.SDcs.AI2025-08ACL

提出双向属性建模的音乐生成框架,提升生成速度与控制精度。

Amadeus: Autoregressive Model with Bidirectional Attribute Modelling for Symbolic Music

  • 用双向扩散模型处理音符属性,打破传统顺序依赖
  • 在多个指标上超越当前最优模型,速度提升4倍以上
  • 支持无需训练的精细属性控制,适合音乐创作与交互设计

现有符号音乐生成模型多采用自回归架构,将音乐视为属性序列,依赖单向时间依赖关系。但实验发现,以不同属性为初始词元时性能相近,表明音符属性本质是并行且无序的集合。基于此,我们提出Amadeus框架:采用自回归模型生成音符序列,结合双向离散扩散模型建模属性。为提升性能,提出音乐潜在空间可区分性增强策略(MLSDES),引入对比学习强化中间表示判别性;设计条件信息增强模块(CIEM),通过注意力机制增强音符隐向量表达,实现更精准解码。在无条件与文本条件生成任务中广泛实验,Amadeus显著优于当前最先进模型,且至少提速4倍。进一步证明了无需训练即可实现细粒度音符属性控制的可行性。为探索该架构上限,我们构建了迄今最大的开源符号音乐数据集AMD(Amadeus MIDI Dataset),支持预训练与微调。

原文摘要 · Abstract (English)

Existing state-of-the-art symbolic music generation models predominantly adopt autoregressive or hierarchical autoregressive architectures, modelling symbolic music as a sequence of attribute tokens with unidirectional temporal dependencies, under the assumption of a fixed, strict dependency structure among these attributes. However, we observe that using different attributes as the initial token in these models leads to comparable performance. This suggests that the attributes of a musical note are, in essence, a concurrent and unordered set, rather than a temporally dependent sequence. Based on this insight, we introduce Amadeus, a novel symbolic music generation framework. Amadeus adopts a two-level architecture: an autoregressive model for note sequences and a bidirectional discrete diffusion model for attributes. To enhance performance, we propose Music Latent Space Discriminability Enhancement Strategy(MLSDES), incorporating contrastive learning constraints that amplify discriminability of intermediate music representations. The Conditional Information Enhancement Module (CIEM) simultaneously strengthens note latent vector representation via attention mechanisms, enabling more precise note decoding. We conduct extensive experiments on unconditional and text-conditioned generation tasks. Amadeus significantly outperforms SOTA models across multiple metrics while achieving at least 4$\times$ speed-up. Furthermore, we demonstrate training-free, fine-grained note attribute control feasibility using our model. To explore the upper performance bound of the Amadeus architecture, we compile the largest open-source symbolic music dataset to date, AMD (Amadeus MIDI Dataset), supporting both pre-training and fine-tuning.

音乐生成自回归扩散模型属性控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。