arXiv:2511.07156cs.LGcs.AI2025-11

用扩散模型做隐空间约束,精准控制音乐生成的多个属性。

Conditional Diffusion as Latent Constraints for Controllable Symbolic Music Generation

  • 将小规模条件扩散模型作为隐空间的隐式先验约束。
  • 在音符密度、音域、旋律轮廓等属性上相关性提升显著。
  • 适合需要精细调节音乐特征的作曲家或专业用户。

近年来,潜在扩散模型在高维时序数据合成中表现卓越,可通过条件输入和引导实现灵活控制。然而,现有方法主要依赖音乐上下文或自然语言交互,对追求精确如调音旋钮般控制特定音乐属性的专家用户而言并不理想。本文探索将去噪扩散过程作为即插即用的隐空间约束,应用于无条件符号音乐生成模型。核心框架利用一组小型条件扩散模型,作为冻结的无条件主干网络隐空间的隐式概率先验。尽管此前已有领域特定应用研究,但据我们所知,这是首个在多样音乐属性(如音符密度、音域、旋律轮廓、节奏复杂度)上展示该方法通用性的工作。实验表明,扩散驱动的约束优于传统属性正则化及其他隐空间约束架构,在目标属性与生成结果间建立更强相关性的同时,保持了高质量与多样性。

原文摘要 · Abstract (English)

Recent advances in latent diffusion models have demonstrated state-of-the-art performance in high-dimensional time-series data synthesis while providing flexible control through conditioning and guidance. However, existing methodologies primarily rely on musical context or natural language as the main modality of interacting with the generative process, which may not be ideal for expert users who seek precise fader-like control over specific musical attributes. In this work, we explore the application of denoising diffusion processes as plug-and-play latent constraints for unconditional symbolic music generation models. We focus on a framework that leverages a library of small conditional diffusion models operating as implicit probabilistic priors on the latents of a frozen unconditional backbone. While previous studies have explored domain-specific use cases, this work, to the best of our knowledge, is the first to demonstrate the versatility of such an approach across a diverse array of musical attributes, such as note density, pitch range, contour, and rhythm complexity. Our experiments show that diffusion-driven constraints outperform traditional attribute regularization and other latent constraints architectures, achieving significantly stronger correlations between target and generated attributes while maintaining high perceptual quality and diversity.

音乐生成扩散模型隐空间约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。