arXiv:2509.23878cs.SDcs.AI2025-09

统一建模钢琴演奏与转录,分离乐谱内容与表演风格。

Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription

  • 通过变换器架构分离音符内容与全局表演风格
  • 仅用序列对齐数据训练,实现内容与风格解耦
  • 扩散模型生成风格嵌入,支持多样式灵活演奏

表达性演奏渲染(EPR)和自动钢琴转录(APT)是音乐信息检索中基础但互逆的任务:前者从符号乐谱生成富有表现力的演奏,后者从演奏中恢复乐谱。尽管二者具有双重性,以往工作却分别处理。本文提出一个统一框架,通过从成对与非成对数据中分离音符级乐谱内容与全局表演风格表示,联合建模EPR与APT。框架基于基于Transformer的序列到序列架构,仅使用序列对齐数据进行训练,无需细粒度音符级对齐。为在自动化渲染的同时确保风格与乐谱兼容,引入独立的基于扩散的表演风格推荐模块,直接从乐谱内容生成风格嵌入。该模块支持风格迁移及多种表现风格下的灵活渲染。客观与主观评估结果表明,本框架在EPR与APT任务上均达到竞争力水平,同时实现了有效的内容-风格解耦、可靠的风格迁移和风格恰当的演奏。演示地址:https://jointpianist.github.io/epr-apt/

原文摘要 · Abstract (English)

Expressive performance rendering (EPR) and automatic piano transcription (APT) are fundamental yet inverse tasks in music information retrieval: EPR generates expressive performances from symbolic scores, while APT recovers scores from performances. Despite their dual nature, prior work has addressed them independently. In this paper we propose a unified framework that jointly models EPR and APT by disentangling note-level score content and global performance style representations from both paired and unpaired data. Our framework is built on a transformer-based sequence-to-sequence architecture and is trained using only sequence-aligned data, without requiring fine-grained note-level alignment. To automate the rendering process while ensuring stylistic compatibility with the score, we introduce an independent diffusion-based performance style recommendation module that generates style embeddings directly from score content. This modular component supports both style transfer and flexible rendering across a range of expressive styles. Experimental results from both objective and subjective evaluations demonstrate that our framework achieves competitive performance on EPR and APT tasks, while enabling effective content-style disentanglement, reliable style transfer, and stylistically appropriate rendering. Demos are available at https://jointpianist.github.io/epr-apt/

钢琴渲染风格解耦联合建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。