arXiv:2511.14250cs.SDcs.LG2025-11被引 3

用音符统计直推音乐转录,省去逐帧标注

Count The Notes: Histogram-Based Supervision for Automatic Music Transcription

  • 用音符出现频次做监督信号,无需精细对齐
  • 在钢琴、吉他等数据集上性能超越现有弱监督方法
  • 适合标注成本高或多乐器场景的音乐转录任务

自动音乐转录(AMT)将音频转换为符号化乐谱。传统深度神经网络训练依赖精确到帧的标注数据,但构建此类数据集成本高昂且难以推广。现有弱监督方法虽使用段级标注,仍需动态时间规整(DTW)或软对齐损失,依赖局部语义对应,易出错且计算量大。本文提出CountEM框架,通过音符事件直方图作为监督信号,彻底消除显式局部对齐需求,采用期望最大化(EM)迭代优化,仅凭音符出现次数即可逐步提升预测精度,显著降低标注负担。在钢琴、吉他及多乐器数据集上的实验表明,CountEM在性能上匹配甚至超越现有弱监督方法,提升了转录的鲁棒性、可扩展性和效率。

原文摘要 · Abstract (English)

Automatic Music Transcription (AMT) converts audio recordings into symbolic musical representations. Training deep neural networks (DNNs) for AMT typically requires strongly aligned training pairs with precise frame-level annotations. Since creating such datasets is costly and impractical for many musical contexts, weakly aligned approaches using segment-level annotations have gained traction. However, existing methods often rely on Dynamic Time Warping (DTW) or soft alignment loss functions, both of which still require local semantic correspondences, making them error-prone and computationally expensive. In this article, we introduce CountEM, a novel AMT framework that eliminates the need for explicit local alignment by leveraging note event histograms as supervision, enabling lighter computations and greater flexibility. Using an Expectation-Maximization (EM) approach, CountEM iteratively refines predictions based solely on note occurrence counts, significantly reducing annotation efforts while maintaining high transcription accuracy. Experiments on piano, guitar, and multi-instrument datasets demonstrate that CountEM matches or surpasses existing weakly supervised methods, improving AMT's robustness, scalability, and efficiency. Our project page is available at https://yoni-yaffe.github.io/count-the-notes.

音乐转录弱监督直方图监督EM算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。