为钢琴指法标注开发网页工具，支持多模态审查与标注可追溯。
PiAnnotate: A Web Annotation Tool for Piano Fingering, with a Diagnostic Probe
- 融合乐谱、视频与3D手部模型，实现指法标注的多角度验证。
- 保留规则生成与人工修正双轨标注，支持标注过程可审计。
- 训练小规模Transformer探针，验证人工修正具有可学习规律。
指法影响演奏方式，但表演后标注难度大。标注者需结合乐谱、时间、视频与手部动作判断每音符的指法。我们提出PiAnnotate，一个基于网页的流程，用于对FurElise表演数据集添加专家级指法标注。该工具整合了钢琴谱视图、表演视频和3D MANO手部网格，使审校者可在音乐与物理情境下检视每一处指法分配。不同于仅存储最终结果，PiAnnotate同时保存规则生成与人工编辑的双轨指法轨迹。这使得标注历史可追溯：显示几何规则何时足够，专家在何处介入，以及标签在多轮审校中如何变化。作为诊断测试，我们在双轨轨迹上训练小型Transformer探针。该探针在未见曲目上优于规则基线，且对已正确标签保持保守，表明人工修正包含可学习结构而非孤立修正。
原文摘要 · Abstract (English)
Piano fingering shapes how a passage can be played, yet it is difficult to label after a performance. An annotator must decide which finger produced each note while reconciling the score, timing, video, and hand motion. We present PiAnnotate, a web-based pipeline for adding expert fingering annotations to the FurElise performance dataset. The tool brings together a piano-roll view, performance video, and a 3D MANO hand mesh so that reviewers can inspect each assignment in musical and physical context. Rather than storing only the final answer, PiAnnotate keeps paired rule-based and human-edited fingering tracks. These paired tracks make the annotation history auditable by showing where a geometric rule was sufficient, where experts intervened, and how labels changed across review passes. As a final diagnostic, we train a small Transformer probe on the paired tracks. The probe improves on the rule baseline on held-out pieces while remaining conservative about changing labels that were already correct, suggesting that the edited labels contain learnable structure rather than only isolated fixes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。