arXiv:2606.31349eess.SPcs.AI2026-06

用压力信号指导肌电图手势识别,提升跨人跨时的识别准确率。

PGUDA: Pressure-Guided Unsupervised Domain Adaptation with Cross-Modal Knowledge Distillation for sEMG-Based Gesture Recognition

论文配图:PGUDA: Pressure-Guided Unsupervised Domain Adaptation with Cross-Modal Knowledge Distillation for sEMG-Based Gesture Recognition
图 1 · 摘自论文原文
  • 利用压力信号作为教师模型,引导肌电图学生模型学习稳定特征。
  • 仅用5%标注数据即达到全监督水平,跨人/跨时任务平均准确率达58.08%。
  • 适合低标注成本场景,显著降低实际肌电系统校准负担。

基于表面肌电(sEMG)的手势识别是自然人机交互的前沿技术,但因不同受试者和记录会话间特征分布差异,实际部署困难。传统域适应方法难以有效对齐具有随机性的sEMG特征,且标注数据稀缺。本文提出一种新型无监督域适应框架PGUDA,利用压力信号的鲁棒性,通过跨模态知识蒸馏将一致物理语义迁移至多模态。具体而言,以压力信号训练的教师网络指导目标域中未标注的sEMG学生网络,以转移可迁移、模态不变的知识,规范表示学习过程。在自采集的11名受试者多模态数据集上进行大量实验验证,结果表明PGUDA在跨人与跨时分类任务中均达领先性能,平均准确率达58.08%,显著优于现有方法。尤为突出的是其极强的标签效率:仅需5%标注数据训练教师网络,即可获得接近全监督基准的识别精度。该框架为实际应用中的肌电手势识别提供了高效、稳健的解决方案。

原文摘要 · Abstract (English)

Surface electromyography (sEMG)-based gesture recognition has emerged as a promising technology for natural human-computer interaction. However, its practical deployment remains challenging due to severe performance degradation caused by feature distribution discrepancies across different subjects and recording sessions. Although domain adaptation (DA) techniques are commonly employed to mitigate such discrepancies, conventional methods often struggle to effectively aligning sEMG features, primarily due to their inherent stochasticity and the scarcity of labeled data. To address these limitations, this paper proposes a novel Pressure-Guided Unsupervised Domain Adaptation (PGUDA) framework, which leverages the robustness and stability of pressure signals to introduce a cross-modal knowledge distillation strategy that transfers consistent physical semantics across modalities. Specifically, a teacher network trained on pressure signals guides an sEMG student network on unlabeled target domains, thereby regularizing the representation learning process with transferable and modality-invariant knowledge. Extensive experiments conducted on a self-collected multimodal dataset involving eleven subjects validate the effectiveness of the proposed PGUDA framework. The results demonstrate that our proposed PGUDA achieves leading performance in both cross-subject and cross-session classification tasks, achieving average accuracies of 58.08% and substantially outperforming existing DA approaches. Notably, PGUDA exhibits remarkable label efficiency: it attains classification accuracy comparable to fully supervised benchmarks while requiring only 5% of labeled data for teacher network training. This framework offers a robust and data-efficient solution that can significantly reduce the calibration burden in practical sEMG-based gesture recognition systems.

肌电识别域适应跨模态少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。