用光学方法非侵入式捕捉古董键盘乐器的按键运动,支持真实演奏数据采集。
PHOTON: Non-Invasive Optical Tracking of Key-Lever Motion in Historical Keyboard Instruments

- 通过安装在键杠杆底部的反射式传感器,实时追踪按键垂直位移。
- 可适配大键琴等古乐器的复杂结构,支持多手键盘和不同键数配置。
- 开源软硬件设计,适合音乐学研究与历史乐器数字化项目使用。
本文介绍PHOTON(PHysical Optical Tracking of Notes)系统,一种用于测量古董键盘乐器键杠杆运动的非侵入式光学传感方案。该系统通过安装在键杠杆远端下方的反射式光学传感器,连续获取键杠杆的垂直位移、时间及触键信息,完整记录演奏者输入与乐器机械阻力共同作用下的运动形态。与专为现代钢琴设计的系统不同,PHOTON可适配大键琴、古钢琴及早期钢琴等具有多样几何结构、有限空间间隙和非标准布局的乐器。其模块化、低轮廓架构支持多手键盘与可变键数配置下的高分辨率、低延迟传感。系统不仅可用于表演数据采集,还提供实时MIDI输出,并支持对表现性手势、人机交互关系的研究以及基于真实历史机制构建专用MIDI语料库。整个系统以开源形式发布,包含KiCad开发的电路图与PCB布局,以及用CircuitPython编写的固件,降低复制、扩展与应用门槛。
原文摘要 · Abstract (English)
This paper introduces PHOTON (PHysical Optical Tracking of Notes), a non-invasive optical sensing system for measuring key-lever motion in historical keyboard instruments. PHOTON tracks the vertical displacement of the key lever itself, capturing motion shaped by both performer input and the instrument's mechanically imposed, time-varying load. Reflective optical sensors mounted beneath the distal end of each lever provide continuous displacement, timing, and articulation data without interfering with the action. Unlike existing optical systems designed for modern pianos, PHOTON accommodates the diverse geometries, limited clearances, and non-standard layouts of harpsichords, clavichords, and early fortepianos. Its modular, low-profile architecture enables high-resolution, low-latency sensing across multiple manuals and variable key counts. Beyond performance capture, PHOTON provides real-time MIDI output and supports empirical study of expressive gesture, human-instrument interaction, and the construction of instrument-specific MIDI corpora using real historical mechanisms. The complete system is released as open-source hardware and software, from schematics and PCB layouts developed in KiCad to firmware written in CircuitPython, lowering the barrier to adoption, replication, and extension.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。