用肌电图实现无创打字识别,数据量超346小时
emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography
- 通过腕部肌电传感器采集打字时的肌肉信号
- 覆盖108人、346小时,是目前最大公开数据集
- 为机器学习与神经科学提供可复现基准
表面肌电图(sEMG)非侵入性地测量肌肉活动信号,具备检测单个脊髓神经元的灵敏度和识别数十种手势及其细微差异的能力。基于腕部的可穿戴sEMG传感器有望提供低摩擦、隐蔽、信息丰富且持续可用的人机输入方式。为此,我们提出emg2qwerty,一个大规模公开数据集,记录了用户在QWERTY键盘上盲打时腕部的sEMG信号,包含真实标签和可复现的基线模型。该数据集涵盖1,135个会话、108名用户和346小时的录制数据,是目前同类数据中规模最大的。数据揭示了从神经元到肌肉及肌肉组合的生成过程具有明显层级结构,同时跨用户和会话存在显著领域偏移。借鉴自动语音识别(ASR)领域的标准建模方法,我们展示了仅使用sEMG信号即可实现强基线打字预测性能。我们认为该任务与数据集的丰富性将推动机器学习与神经科学领域的多项研究进展。数据与代码可在https://github.com/facebookresearch/emg2qwerty获取。
原文摘要 · Abstract (English)
Surface electromyography (sEMG) non-invasively measures signals generated by muscle activity with sufficient sensitivity to detect individual spinal neurons and richness to identify dozens of gestures and their nuances. Wearable wrist-based sEMG sensors have the potential to offer low friction, subtle, information rich, always available human-computer inputs. To this end, we introduce emg2qwerty, a large-scale dataset of non-invasive electromyographic signals recorded at the wrists while touch typing on a QWERTY keyboard, together with ground-truth annotations and reproducible baselines. With 1,135 sessions spanning 108 users and 346 hours of recording, this is the largest such public dataset to date. These data demonstrate non-trivial, but well defined hierarchical relationships both in terms of the generative process, from neurons to muscles and muscle combinations, as well as in terms of domain shift across users and user sessions. Applying standard modeling techniques from the closely related field of Automatic Speech Recognition (ASR), we show strong baseline performance on predicting key-presses using sEMG signals alone. We believe the richness of this task and dataset will facilitate progress in several problems of interest to both the machine learning and neuroscientific communities. Dataset and code can be accessed at https://github.com/facebookresearch/emg2qwerty.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。