两个网页工具箱，一键采集钢琴演奏多模态数据并标注指法。
Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation
- PiaRec同步采集音频、视频、MIDI和演奏元数据。
- ASDF从视觉数据高效标注演奏者指法。
- 适合音乐信息检索与人机交互研究者使用。
钢琴演奏是一种融合物理动作与声音表现的多模态活动。尽管学界对钢琴演奏的多模态特性日益关注，但大规模多模态数据的采集仍因耗时费力而成为主要瓶颈。为突破此限制，我们提出一个集成式网页工具箱，包含两个图形化界面：(i) PiaRec，支持音频、视频、MIDI及演奏元数据的同步采集；(ii) ASDF，可从视觉数据中高效标注演奏者指法。该系统整体可显著提升多模态钢琴演奏数据集的构建效率。
原文摘要 · Abstract (English)
Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal nature of piano performance, the laborious process of acquiring large-scale multimodal data remains a significant bottleneck, hindering further progress in this field. To overcome this barrier, we present an integrated web toolkit comprising two graphical user interfaces (GUIs): (i) PiaRec, which supports the synchronized acquisition of audio, video, MIDI, and performance metadata. (ii) ASDF, which enables the efficient annotation of performer fingering from the visual data. Collectively, this system can streamline the acquisition of multimodal piano performance datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。