arXiv:2506.12356cs.HCcs.LG2025-06NeurIPS被引 1

通过分拆共享结构提升肌电打字准确率与效率

SplashNet: Split-and-Share Encoders for Accurate and Efficient Typing with Surface Electromyography

  • 采用分拆共享编码器,模拟双手协同的神经肌肉对称性
  • 零样本下字符错误率降至36.4%,微调后5.9%
  • 模型参数减至四分之一,推理速度更快,适合便携设备

腕部表面肌电(sEMG)可实现自然、无需键盘的文本输入,但现有emg2qwerty基线在未见用户零样本设置下字符误识别率达51.8%,微调后仍为7.0%。本文发现错误主要源于跨用户信号统计差异、对高阶特征依赖过强,以及缺乏符合双侧书写生理结构的架构先验。为此提出三项改进:(i) 滚动时间归一化,自适应对齐跨用户输入分布;(ii) 强制通道掩码,鼓励使用更易泛化的低阶特征组合;(iii) 分拆共享编码器,双侧独立处理并共享权重,体现神经肌肉系统对称性。结合频谱分辨率降低五倍(33→6频带),构建轻量级SplashNet-mini,参数仅为基线的1/4,计算量0.6倍,零样本CER降至36.4%,微调后5.9%。放大版SplashNet(参数为基线1/2,算力1.15倍)进一步将错误率降至35.7%和5.5%,相对提升31%与21%,达到新基准且无需额外数据。

原文摘要 · Abstract (English)

Surface electromyography (sEMG) at the wrists could enable natural, keyboard-free text entry, yet the state-of-the-art emg2qwerty baseline still misrecognizes $51.8\%$ of characters in the zero-shot setting on unseen users and $7.0\%$ after user-specific fine-tuning. We trace many of these errors to mismatched cross-user signal statistics, fragile reliance on high-order feature dependencies, and the absence of architectural inductive biases aligned with the bilateral nature of typing. To address these issues, we introduce three simple modifications: (i) Rolling Time Normalization, which adaptively aligns input distributions across users; (ii) Aggressive Channel Masking, which encourages reliance on low-order feature combinations more likely to generalize across users; and (iii) a Split-and-Share encoder that processes each hand independently with weight-shared streams to reflect the bilateral symmetry of the neuromuscular system. Combined with a five-fold reduction in spectral resolution ($33\!\rightarrow\!6$ frequency bands), these components yield a compact Split-and-Share model, SplashNet-mini, which uses only $\tfrac14$ the parameters and $0.6\times$ the FLOPs of the baseline while reducing character-error rate (CER) to $36.4\%$ zero-shot and $5.9\%$ after fine-tuning. An upscaled variant, SplashNet ($\tfrac12$ the parameters, $1.15\times$ the FLOPs of the baseline), further lowers error to $35.7\%$ and $5.5\%$, representing relative improvements of $31\%$ and $21\%$ in the zero-shot and fine-tuned settings, respectively. SplashNet therefore establishes a new state of the art without requiring additional data.

肌电控制高效模型零样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。