arXiv:2606.24912cs.SDcs.AI2026-06中稿 · publication at the…

为吉他自动转录设计速度预测方法,用合成数据训练模型。

Velocity Prediction in Automatic Guitar Transcription

论文配图:Velocity Prediction in Automatic Guitar Transcription
图 1 · 摘自论文原文
  • 用虚拟乐器生成带力度标签的合成数据训练模型。
  • 在真实吉他音频上微调后,速度预测优于基线模型。
  • 提升转录精度,适合音乐信号处理与演奏分析研究者。

自动音乐转录(AMT)模型在多种乐器的多声部转录中已取得显著进展。然而,由于现有数据集缺乏力度标签,且除钢琴外其他乐器的力度定义不明确,力度预测在这些模型中较少被考虑。本文提出一种用于吉他自动转录(AGT)的力度预测方法,利用虚拟乐器生成带有力度标签的合成训练数据。首先在合成数据上预训练模型,再将权重迁移到另一模型并在真实吉他音频上微调,使模型在保留良好力度预测能力的同时,也获得高性能和强泛化能力。在合成数据上的评估显示,使用预训练力度权重的模型优于不使用该权重的基线模型。此外,预训练权重对音符转录有轻微提升,但效果有限且依赖测试数据。总体而言,该模型在吉他转录任务上达到与当前最优水平相当的表现,同时成功实现力度预测。

原文摘要 · Abstract (English)

Automatic Music Transcription (AMT) models have achieved a high level of success in polyphonic transcription of various instruments. Velocity, typically a measure of note intensity, is less commonly predicted in these models due to the absence of velocity labels in available datasets and lack of a proper definition for instruments other than piano. We present a methodology and model for velocity prediction in Automatic Guitar Transcription (AGT) which uses virtual instruments to generate synthetic training data with velocity labels. We first pretrain a model on this synthetic data. These weights are then transferred to a different model and trained on real guitar audio, allowing the model to retain the working velocity prediction while also achieving high performance and generalisability from the real training data. The velocity prediction is shown to outperform a baseline model which does not use the pretrained velocity weights, when evaluated on synthetic data. In addition, using the pretrained velocity weights offers a small improvement in note transcription, though the magnitude of this improvement is limited and not always significant depending on the testing data. Overall the model achieves results comparable to the state of the art in guitar transcription, while also successfully predicting velocity.

吉他转录力度预测合成数据迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。