让音乐模型根据已有伴奏生成协调的新伴奏,支持节奏控制。
STAGE: Stemmed Accompaniment Generation through Prefix-Based Conditioning
- 用前缀条件控制让模型理解输入伴奏,生成匹配的单音轨伴奏。
- 生成伴奏与原曲更连贯、音质更高,且更贴合文字提示。
- 无需额外模块即可实现节奏约束,适合音乐人互动创作。
生成模型虽已能产出高质量音乐,但多数仅支持从零生成,难以融入音乐人迭代创作流程。本文提出STAGE模型,基于MusicGen改进,通过在嵌入矩阵中加入上下文标记,实现对给定混音的前缀条件生成单音轨伴奏。相比基线方法,STAGE生成的伴奏与输入混音更连贯、音频质量更高,且与文本提示匹配度更好。此外,通过以节拍器类轨道为条件,系统可自然实现节奏约束生成,在不引入额外时序模块的前提下,达到当前最优的节奏结构对齐效果。该模型为音乐人提供了一种可直接融入实际工作流的实用交互式创作工具。
原文摘要 · Abstract (English)
Recent advances in generative models have made it possible to create high-quality, coherent music, with some systems delivering production-level output. Yet, most existing models focus solely on generating music from scratch, limiting their usefulness for musicians who want to integrate such models into a human, iterative composition workflow. In this paper we introduce STAGE, our STemmed Accompaniment GEneration model, fine-tuned from the state-of-the-art MusicGen to generate single-stem instrumental accompaniments conditioned on a given mixture. Inspired by instruction-tuning methods for language models, we extend the transformer's embedding matrix with a context token, enabling the model to attend to a musical context through prefix-based conditioning. Compared to the baselines, STAGE yields accompaniments that exhibit stronger coherence with the input mixture, higher audio quality, and closer alignment with textual prompts. Moreover, by conditioning on a metronome-like track, our framework naturally supports tempo-constrained generation, achieving state-of-the-art alignment with the target rhythmic structure--all without requiring any additional tempo-specific module. As a result, STAGE offers a practical, versatile tool for interactive music creation that can be readily adopted by musicians in real-world workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。