用半监督BERT实现高效钢琴简谱自动生成
Towards Practical Automatic Piano Reduction using BERT with Semi-supervised Learning
- 分两步简化旋律并和声,利用MidiBERT框架
- 仅需少量标注数据即可生成可实用的简谱
- 适合音乐自动化与作曲辅助研究者
本文提出一种基于半监督学习的自动钢琴简谱方法。钢琴简谱是音乐创作与分析中的重要转换过程,但手工操作耗时费力。尽管监督学习在输入输出映射中有效,但高质量标注数据难以获取。为此,我们利用古典音乐海量未标注数据,通过半监督策略降低标注成本。采用两阶段流程:先简化旋律,再进行和声处理。基于现有MidiBERT框架,提出两种解决方案。实验表明,生成结果准确且自然,只需微调即可使用。本研究为半监督学习在自动钢琴简谱中的应用奠定基础,可供后续研究参考。
原文摘要 · Abstract (English)
In this study, we present a novel automatic piano reduction method with semi-supervised machine learning. Piano reduction is an important music transformation process, which helps musicians and composers as a musical sketch for performances and analysis. The automation of such is a highly challenging research problem but could bring huge conveniences as manually doing a piano reduction takes a lot of time and effort. While supervised machine learning is often a useful tool for learning input-output mappings, it is difficult to obtain a large quantity of labelled data. We aim to solve this problem by utilizing semi-supervised learning, so that the abundant available data in classical music can be leveraged to perform the task with little or no labelling effort. In this regard, we formulate a two-step approach of music simplification followed by harmonization. We further propose and implement two possible solutions making use of an existing machine learning framework -- MidiBERT. We show that our solutions can output practical and realistic samples with an accurate reduction that needs only small adjustments in post-processing. Our study forms the groundwork for the use of semi-supervised learning in automatic piano reduction, where future researchers can take reference to produce more state-of-the-art results.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。