arXiv:2510.10175cs.SDeess.AS2025-10中稿 · APSIPA ASC 2025

用分数感知判别器提升低信息量音乐表现力生成效果

Peransformer: Improving Low-informed Expressive Performance Rendering with Score-aware Discriminator

  • 基于Transformer架构,利用分数导出的MIDI作为输入
  • 在主观评测中达到低信息量系统最佳性能
  • 提出通用评估指标GEM,实现跨系统公平对比

高信息量音乐表现力生成(EPR)系统可将带丰富音乐标注的乐谱转换为类人表现的演奏MIDI文件。尽管已有良好成果,但完整乐谱数据远少于MIDI文件,且在数字音频工作站(DAW)中灵活性差。近年来低信息量EPR系统通过直接使用乐谱导出的MIDI作为输入,提供了更便捷的替代方案,但性能常不理想。现有研究采用多样化的自动评估指标和数据格式,难以进行客观比较。本文提出Peransformer,一种基于Transformer的低信息量EPR系统,引入分数感知判别器,利用配对的乐谱-演奏、逐音对齐的MIDI数据进行训练。实验表明,Peransformer在主观评价中达到当前低信息量系统最优水平。此外,我们扩展了现有自动评估指标,提出通用音乐表现力评估指标(GEM),支持更直接、准确、可靠的EPR系统间比较。

原文摘要 · Abstract (English)

Highly-informed Expressive Performance Rendering (EPR) systems transform music scores with rich musical annotations into human-like expressive performance MIDI files. While these systems have achieved promising results, the availability of detailed music scores is limited compared to MIDI files and are less flexible to work with using a digital audio workstation (DAW). Recent advancements in low-informed EPR systems offer a more accessible alternative by directly utilizing score-derived MIDI as input, but these systems often exhibit suboptimal performance. Meanwhile, existing works are evaluated with diverse automatic metrics and data formats, hindering direct objective comparisons between EPR systems. In this study, we introduce Peransformer, a transformer-based low-informed EPR system designed to bridge the gap between low-informed and highly-informed EPR systems. Our approach incorporates a score-aware discriminator that leverages the underlying score-derived MIDI files and is trained on a score-to-performance paired, note-to-note aligned MIDI dataset. Experimental results demonstrate that Peransformer achieves state-of-the-art performance among low-informed systems, as validated by subjective evaluations. Furthermore, we extend existing automatic evaluation metrics for EPR systems and introduce generalized EPR metrics (GEM), enabling more direct, accurate, and reliable comparisons across EPR systems.

音乐生成Transformer评估指标低信息量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。