arXiv:2605.13431cs.SD2026-05被引 1

用自然语言生成五线谱,不依赖嘈杂的文本配对数据

Text2Score: Generating Sheet Music From Textual Prompts

论文配图:Text2Score: Generating Sheet Music From Textual Prompts
图 1 · 摘自论文原文
  • 分两阶段生成:先用大模型规划音乐结构,再按计划生成带约束的乐谱
  • 在可演奏性、可读性等五项指标上优于纯大模型和端到端基线
  • 适合音乐创作、教育场景,开源了数据集和演示链接

文本驱动的符号化音乐生成因缺乏对齐的文本-音乐数据集及不可靠的自动标注管道而面临挑战。尽管多数研究聚焦于MIDI,基于五线谱的文本生成仍被严重忽视。我们提出Text2Score,一种两阶段框架,包含规划阶段与执行阶段,从自然语言提示生成五线谱。通过直接从符号化XML数据中提取监督信号,我们提出一种替代传统基于字幕训练的方法,避免噪声或稀缺的文本-音乐配对问题。规划阶段由大模型编排器将自然语言提示转化为结构化的按小节规划,定义乐器、调性、拍号、和声等属性;执行阶段则利用生成模型在结构约束下输出交错的ABC记谱法。为评估生成质量,我们构建了一个涵盖可演奏性、可读性、乐器使用率、结构复杂度和提示符合度的评估框架,并获得专业音乐人验证。Text2Score在客观与主观维度上均持续优于纯大模型代理框架及三种端到端基线。我们开源了数据集、代码、评估集及大模型提示;演示可在项目主页(https://keshavbhandari.github.io/portfolio/text2score)查看。

原文摘要 · Abstract (English)

Developing text-driven symbolic music generation models remains challenging due to the scarcity of aligned text-music datasets and the unreliability of automated captioning pipelines. While most efforts have focused on MIDI, sheet music representations are largely underexplored in text-driven generation. We present \textit{Text2Score}, a two-stage framework comprising a planning stage and an execution stage for generating sheet music from natural language prompts. By deriving supervision signals directly from symbolic XML data, we propose an alternative to caption-based training that bypasses noisy or scarce text-music pairs. In the planning stage, an LLM orchestrator translates a natural language prompt into a structured bar-wise plan defining musical attributes such as instruments, key, time signatures, harmony, etc. This plan guides a generative model in the execution stage to produce interleaved ABC notation conditioned on its structural constraints. To assess output quality, we introduce an evaluation framework covering playability, readability, instrument utilization, structural complexity, and prompt adherence, corroborated by expert musicians. \textit{Text2Score} consistently outperforms both a pure LLM-based agentic framework and three end-to-end baselines across objective and subjective dimensions. We open-source the dataset, code, evaluation set and LLM prompts used in this work; a demo is available on our project page (https://keshavbhandari.github.io/portfolio/text2score).

音乐生成文本生成五线谱大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。