用和弦进行增强音乐生成，支持文本控制的混音创作。
MusicGen-Chord: Advancing Music Generation through Chord Progressions and Interactive Web-UI
- 将旋律音高向量转为和弦多热编码，融合和弦进展生成
- 支持文本描述控制的音乐混音生成，可交互操作
- 集成至网页界面，适合音乐人与创作者快速试用
MusicGen 是一种可基于文本描述和旋律特征进行条件生成的音乐生成语言模型。本文提出 MusicGen-Chord，通过引入和弦进行特征扩展其能力。该模型将原本的一热编码旋律音高向量转换为多热编码的和弦音高向量，使生成的音乐能同时体现和弦进行与文本描述。此外，我们开发了 MusicGen-Remixer 应用，利用 MusicGen-Chord 根据文本描述对输入音乐生成混音。两个模型均通过 cog 集成至 Replicate 的网页界面，实现用户友好的可控交互，提升 AI 音乐创作的可及性与体验感。
原文摘要 · Abstract (English)
MusicGen is a music generation language model (LM) that can be conditioned on textual descriptions and melodic features. We introduce MusicGen-Chord, which extends this capability by incorporating chord progression features. This model modifies one-hot encoded melody chroma vectors into multi-hot encoded chord chroma vectors, enabling the generation of music that reflects both chord progressions and textual descriptions. Furthermore, we developed MusicGen-Remixer, an application utilizing MusicGen-Chord to generate remixes of input music conditioned on textual descriptions. Both models are integrated into Replicate's web-UI using cog, facilitating broad accessibility and user-friendly controllable interaction for creating and experiencing AI-generated music.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。