在微控制器上实现实时高密度肌电手势识别,准确率达90%。
NeuroEdge: Real-Time Hand Gesture Recognition with High-Density EMG Using Deep Learning at the Edge

- 设计轻量1D CNN与双模块系统,实现边缘端实时推理。
- 7种手势识别准确率90%,总延迟仅83毫秒。
- 适合假肢控制、康复训练等实时神经接口场景。
高密度肌电图(HD-EMG)已成为解码精细神经肌肉活动的强大信号源,支持假肢控制、康复治疗和增强交互等实时神经机器接口(NMIs)应用。尽管卷积神经网络(CNN)在肌电手势识别中表现出高分类精度,但其在嵌入式硬件上的部署仍受限于计算与内存资源。本文提出NeuroEdge,一个完全在资源受限微控制器上运行的实时HD-EMG神经接口系统。系统包含两个定制模块:用于将Quattrocento放大器的原始数据无线传至ESP32的HD-EMG StreamBridge,以及在Sony Spresense微控制器上运行的轻量级深度学习推理引擎EdgeDL。通过优化的1维CNN对滑动窗口的肌电数据进行实时处理。数据流与推理通过直接内存访问(DMA)与串行外设接口(SPI)突发通信实现流水线同步,保障低延迟性能。实验结果表明,该系统在192通道前臂HD-EMG数据上实现了7种手势90%的实时分类准确率,平均总延迟为83毫秒。本系统证明了复杂HD-EMG手势识别在基于微控制器的边缘设备上部署的可行性,弥合了高分辨率生物信号采集与深度学习嵌入式推理之间的鸿沟。
原文摘要 · Abstract (English)
High-density electromyography (HD-EMG) has emerged as a powerful modality for decoding fine-grained neuromuscular activity, enabling real-time neural-machine interfaces (NMIs) for applications such as prosthetic control, rehabilitation, and augmented interaction. While deep learning approaches such as convolutional neural networks (CNNs)have demonstrated high classification accuracy for EMG-based gesture recognition, their deployment on embedded hardware remains a major challenge due to computational and memory constraints. This paper presents NeuroEdge, a real-time HD EMG-based NMI system that performs gesture recognition entirely on resource-constrained microcontrollers. The system features two custom-designed modules: the HD-EMG StreamBridge, a wireless communication interface that streams raw HD-EMG data from a Quattrocento amplifier to an ESP32 microcontroller; and the EdgeDL Inference Engine, a lightweight deep learning framework executing on a Sony Spresense microcontroller. A compact 1-dimensional CNN optimized for embedded inference processes, sliding windows of EMG data in real time. Data streaming and inference are pipelined and synchronized through an architecture that utilizes Direct Memory Access (DMA) for data transfer and Serial Peripheral Interface (SPI) burst communication between the ESP32 and Spresense, ensuring low-latency performance. Experimental results show that NeuroEdge achieves a real-time classification accuracy of 90% across seven hand gestures, with a total average latency of 83 ms using 192 channels of HD-EMG recorded from the forearm. Our system demonstrates the feasibility of deploying complex HD-EMG-based gesture recognition on microcontroller-based edge devices, bridging the gap between high-resolution biosignal acquisition and deep learning-based embedded inference for next-generation NMIs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。