arXiv:2604.22499cs.LGcs.RO2026-04

用肌电和摄像头实现高维手指运动的实时解码,提升假肢自然控制体验。

Decoding High-Dimensional Finger Motion from EMG Using Riemannian Features and RNNs

论文配图:Decoding High-Dimensional Finger Motion from EMG Using Riemannian Features and RNNs
图 1 · 摘自论文原文
  • 结合肌电信号与视觉信息,构建端到端连续解码框架。
  • 在20人数据集上达到9.79°平均误差,跨被试性能达16.71°。
  • 模型轻量可在树莓派实时运行,适合嵌入式设备部署。

从前臂表面肌电(EMG)连续估计高维手指运动,可实现假肢、AR/XR界面及远程操作的自然控制。然而,人体手势复杂且前臂肌肉相互耦合,准确识别极具挑战性。现有方法多依赖分类模型,限制自由度且影响交互自然性。本文提出端到端连续解码框架,仅使用消费级硬件:8通道肌电臂带、单个摄像头及自动同步流程,构建了10小时的同步肌电-手指关节角数据集(EMG-FK),涵盖20名参与者执行丰富非约束右手动作的15个手指关节角度。同时引入基于GRU的时序黎曼回归器(TRR),利用多频段黎曼协方差特征序列进行解码。在EMG-FK和公开emg2pose基准上,TRR在同被试与跨被试评估中均优于现有方法。在EMG-FK上,同被试平均绝对误差为9.79°±1.48,跨被试为16.71°±3.97。最终实现在Raspberry Pi 5上的实时部署,机器人手控效果直观;TRR推理速度接近10次/秒,较现有方法快一个数量级。这些成果降低了高维肌电解码的复现门槛,推动嵌入式肌电系统向更自然、直观控制发展。

原文摘要 · Abstract (English)

Continuous estimation of high-dimensional finger kinematics from forearm surface electromyography (EMG) could enable natural control for hand prostheses, AR/XR interfaces, and teleoperation. However, the complexity of human hand gestures and the entanglement of forearm muscles make accurate recognition intrinsically challenging. Existing approaches typically reduce task complexity by relying on classification-based machine learning, limiting the controllable degrees of freedom and compromising on natural interaction. We present an end-to-end framework for continuous EMG-to-kinematics regression using only consumer-grade hardware. The framework combines an 8-channel EMG armband, a single webcam, and an automatic synchronization procedure, enabling the collection of the EMG Finger-Kinematics dataset (EMG-FK), a 10-h dataset of synchronized EMG and 15 finger joint angles from 20 participants performing rich, unconstrained right-hand motions. We also introduce the Temporal Riemannian Regressor (TRR), a lightweight GRU-based model that uses sequences of multi-band Riemannian covariance features to decode finger motion. Across EMG-FK and the public emg2pose benchmark, TRR outperforms state-of-the-art methods in both intra- and cross-subject evaluation. On EMG-FK, it reaches an average absolute error of $9.79 °\pm 1.48$ in intra-subject and $16.71 °\pm 3.97$ in cross-subject. Finally, we demonstrate real-time deployment on a Raspberry Pi 5 and intuitive control of a robotic hand; TRR runs at nearly 10 predictions/s and is roughly an order of magnitude faster than state-of-the-art approaches. Together, these contributions lower the barrier to reproducible, real-time EMG-based decoding of high-dimensional finger motion, and pave the way toward more natural and intuitive control of embedded EMG-based systems.

肌电解码手指运动实时控制嵌入式系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。