arXiv:2605.22403cs.CV2026-05

用大模型将肌电信号翻译成语言,实现高精度动作识别

Translating Signals to Languages for sEMG-Based Activity Recognition

论文配图:Translating Signals to Languages for sEMG-Based Activity Recognition
图 1 · 摘自论文原文
  • 将肌电信号映射为语言序列,利用大模型理解动作意图
  • 在多个数据集上达到95%以上识别准确率,优于传统方法
  • 适合想用大模型提升生物信号理解能力的研究者

表面肌电(sEMG)信号的动作识别近年来受到广泛关注。为构建高精度的sEMG识别系统,已有研究通过设计更复杂模型架构或大规模预训练来增强表征能力。近期,大语言模型(LLMs)在自然语言处理中展现出卓越的泛化与推理能力,其从大量动作描述中学习到的隐含知识,为解读sEMG信号并推断动作意图提供了新思路。受此启发,我们提出LLM-sEMG框架,利用大语言模型作为sEMG动作识别器。该框架设计了面向语言的映射机制,将连续的sEMG序列转换为sEMG语言,并结合多种策略优化信号到语言的转换过程。大量实验表明,该框架能有效利用大语言模型实现高精度的sEMG信号动作识别。

原文摘要 · Abstract (English)

Surface electromyography (sEMG) signal-based activity recognition has attracted increasing research attention in recent years. To develop accurate sEMG signal-based activity recognizers, numerous approaches have been proposed. Some studies focus on designing larger and more expressive model architectures to enhance the representational capacity of sEMG signals, while others aim to enrich model priors through large-scale pretraining, thereby improving recognition performance. Recently, large language models (LLMs) have shown remarkable generalization and reasoning capabilities in natural language processing, whose implicit knowledge, learned from extensive linguistic descriptions of actions, opens new possibilities for interpreting sEMG signals and inferring activity intentions. Motivated by this, we propose LLM-sEMG, a novel framework that leverages LLMs as sEMG activity recognizers. Within this framework, we design a language-oriented mapping mechanism that converts continuous sEMG sequences into sEMG language, integrating several strategies to further facilitate the signal-to-language mapping process. Extensive experiments demonstrate that the proposed framework achieves highly accurate sEMG signal-based activity recognition using large language models.

肌电识别大模型信号翻译

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。