用残差瓶颈卷积+双向GRU,实现高精度音乐符号识别
A High-Accuracy Optical Music Recognition Method Based on Bottleneck Residual Convolutions

- 采用残差瓶颈卷积提取符号细节与谱线结构特征
- 在Camera-PrIMuS上达到0.45%符号错误率,音高准确率达99.33%
- 无需对齐标注即可端到端训练,适合音乐数字化项目
光学音乐识别(OMR)旨在将印刷或手写的乐谱图像转换为可编辑的符号表示。本文提出一种端到端的OMR框架,结合残差瓶颈卷积与基于双向门控循环单元(BiGRU)的序列建模。采用具有ResNet-v2风格残差瓶颈块和多尺度空洞卷积的卷积神经网络,提取同时包含细粒度符号细节和全局谱线结构的特征。提取的特征序列输入BiGRU网络以建模音乐符号间的时序依赖关系。模型使用连接时序分类(CTC)损失进行训练,实现无需显式对齐标注的端到端预测。在Camera-PrIMuS和PrIMuS数据集上的实验表明,该框架有效:在Camera-PrIMuS上,序列错误率(SeER)为7.52%,符号错误率(SyER)为0.45%,音高、类型和音符准确率分别为99.33%、99.60%和99.28%;在PrIMuS上,SeER为8.11%,SyER为0.49%,对应准确率分别为99.27%、99.58%和99.21%。平均每轮训练时间仅1.74秒,兼具高效计算与强识别性能。细粒度错误分析进一步验证了模型的有效性。
原文摘要 · Abstract (English)
Optical Music Recognition (OMR) aims to convert printed or handwritten music score images into editable symbolic representations. This paper presents an end-to-end OMR framework that combines residual bottleneck convolutions with bidirectional gated recurrent unit (BiGRU)-based sequence modeling. A convolutional neural network with ResNet-v2-style residual bottleneck blocks and multi-scale dilated convolutions is used to extract features that encode both fine-grained symbol details and global staff-line structures. The extracted feature sequences are then fed into a BiGRU network to model temporal dependencies among musical symbols. The model is trained using the Connectionist Temporal Classification loss, enabling end-to-end prediction without explicit alignment annotations. Experimental results on the Camera-PrIMuS and PrIMuS datasets demonstrate the effectiveness of the proposed framework. On Camera-PrIMuS, the proposed method achieves a sequence error rate (SeER) of $7.52\%$ and a symbol error rate (SyER) of $0.45\%$, with pitch, type, and note accuracies of $99.33\%$, $99.60\%$, and $99.28\%$, respectively. The average training time is 1.74~s per epoch, demonstrating high computational efficiency while maintaining strong recognition performance. On PrIMuS, the method achieves a SeER of $8.11\%$ and a SyER of $0.49\%$, with pitch, type, and note accuracies of $99.27\%$, $99.58\%$, and $99.21\%$, respectively. A fine-grained error analysis further confirms the effectiveness of the proposed model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。