基于肌电的手势识别,通过多分支结构增强时空动态特征提取。
Electromyography-Based Gesture Recognition: Hierarchical Feature Extraction for Enhanced Spatial-Temporal Dynamics
- 设计三分支网络,分别捕捉长期时序、空间-时序特征与双向时间模式。
- 在Ninapro多个数据集上达到92.4%至96.4%的准确率。
- 轻量化设计适合实时应用,适用于假肢控制等辅助技术。
基于多通道表面肌电(sEMG)的手势识别面临预测不稳定和时变特征增强效率低的问题。为此,提出一种轻量级基于挤压-激励的深度学习多流时空动态时变特征提取方法,构建高效的sEMG手势识别系统。模型三分支分别设计:第一分支采用双向时间卷积网络(Bi-TCN),建模过去与未来上下文,捕获长期时序依赖;第二分支结合1D卷积、可分离卷积与挤压-激励(SE)模块,高效提取空间-时序特征并强化关键通道;第三分支融合时间卷积网络(TCN)与双向LSTM,捕捉双向时序关系与动态变化。各分支输出经拼接融合,再通过通道注意力模块精炼,突出最具信息量特征,提升计算效率。在Ninapro DB2、DB4和DB5数据集上分别取得96.41%、92.40%和93.34%的准确率,验证了系统对复杂sEMG动态的建模能力,为假肢控制与人机交互技术带来进展,对辅助技术具有重要意义。
原文摘要 · Abstract (English)
Hand gesture recognition using multichannel surface electromyography (sEMG) is challenging due to unstable predictions and inefficient time-varying feature enhancement. To overcome the lack of signal based time-varying feature problems, we propose a lightweight squeeze-excitation deep learning-based multi stream spatial temporal dynamics time-varying feature extraction approach to build an effective sEMG-based hand gesture recognition system. Each branch of the proposed model was designed to extract hierarchical features, capturing both global and detailed spatial-temporal relationships to ensure feature effectiveness. The first branch, utilizing a Bidirectional-TCN (Bi-TCN), focuses on capturing long-term temporal dependencies by modelling past and future temporal contexts, providing a holistic view of gesture dynamics. The second branch, incorporating a 1D Convolutional layer, separable CNN, and Squeeze-and-Excitation (SE) block, efficiently extracts spatial-temporal features while emphasizing critical feature channels, enhancing feature relevance. The third branch, combining a Temporal Convolutional Network (TCN) and Bidirectional LSTM (BiLSTM), captures bidirectional temporal relationships and time-varying patterns. Outputs from all branches are fused using concatenation to capture subtle variations in the data and then refined with a channel attention module, selectively focusing on the most informative features while improving computational efficiency. The proposed model was tested on the Ninapro DB2, DB4, and DB5 datasets, achieving accuracy rates of 96.41%, 92.40%, and 93.34%, respectively. These results demonstrate the capability of the system to handle complex sEMG dynamics, offering advancements in prosthetic limb control and human-machine interface technologies with significant implications for assistive technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。