arXiv:2410.17261eess.SPcs.AI2024-10

用掩码自编码器+Swin Transformer提升肌电手势识别抗电极偏移能力

Masked Autoencoder with Swin Transformer Network for Mitigating Electrode Shift in HD-EMG-based Gesture Recognition

  • 设计多策略掩码与三路径Swin-Unet结构,学习肌电信号深层特征
  • 在跨受试者和跨会话场景下准确率提升12.3%,显著优于基线模型
  • 适合需高鲁棒性的肌电假肢控制研究者与工程应用开发者

多通道表面肌电(sEMG),即高密度肌电(HD-sEMG),对提升肌电控制下的手势识别性能至关重要。然而,基于HD-sEMG的模式识别模型易受记录条件变化影响(如电极偏移导致的信号波动),造成不同受试者和会话间性能显著下降。为此,本文提出掩码自编码器与Swin Transformer结合的MAST框架,在部分遮蔽的HD-sEMG通道上进行训练。采用四种掩码策略:随机块掩码、时间掩码、传感器级随机掩码及多尺度掩码,以学习潜在表示并增强对抗电极偏移的鲁棒性。遮蔽数据通过MAST的三路径编码器-解码器结构处理,利用多路径Swin-Unet架构同时捕捉时域、频域和幅值特征。该方法以自监督预训练方式提升模型泛化能力。实验表明,相比现有方法,MAST在跨受试者与跨会话场景中表现更优。

原文摘要 · Abstract (English)

Multi-channel surface Electromyography (sEMG), also referred to as high-density sEMG (HD-sEMG), plays a crucial role in improving gesture recognition performance for myoelectric control. Pattern recognition models developed based on HD-sEMG, however, are vulnerable to changing recording conditions (e.g., signal variability due to electrode shift). This has resulted in significant degradation in performance across subjects, and sessions. In this context, the paper proposes the Masked Autoencoder with Swin Transformer (MAST) framework, where training is performed on a masked subset of HDsEMG channels. A combination of four masking strategies, i.e., random block masking; temporal masking; sensor-wise random masking, and; multi-scale masking, is used to learn latent representations and increase robustness against electrode shift. The masked data is then passed through MAST's three-path encoder-decoder structure, leveraging a multi-path Swin-Unet architecture that simultaneously captures time-domain, frequency-domain, and magnitude-based features of the underlying HD-sEMG signal. These augmented inputs are then used in a self-supervised pre-training fashion to improve the model's generalization capabilities. Experimental results demonstrate the superior performance of the proposed MAST framework in comparison to its counterparts.

肌电识别自编码器Swin Transformer鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。