EMG+IMU信号识别动作,发现个性化对人机交互至关重要。
Why Personalization Matters: Cross-Subject Challenges in EMG-IMU-based HRI Activity Recognition

- 用肌电与惯性传感器融合信号,分段提取时频特征
- 跨被试测试准确率显著下降,暴露泛化瓶颈
- 仅需少量新用户样本即可大幅提升识别效果
本研究针对人机交互中的物体交接与装配类场景,基于可穿戴设备进行动作与手势识别。使用Myo臂带采集肌电(EMG)与惯性测量单元(IMU)信号,构建了MAGIC-HRI多模态数据集,包含53类动作,涵盖巴西手语数字(0-9)、手部手势、工具交接动作(拿起/递出/持有)、工具操作任务及通用装配/静止动作,共11名参与者,每类10次采样(每人530样本)。通过肌电能量包络检测肌肉激活,采用滑动窗口处理,提取时域与频域特征。经交叉验证网格搜索调优后,随机森林表现最佳。采用留一被试法(LOSO)评估显示存在显著泛化差距,表明模型高度依赖个体。个性化适配实验表明,引入少量新用户样本可显著提升识别性能。研究贡献包括一个面向人机交互的多模态数据集、严格的泛化性评估,以及实证证明个性化对实际部署不可或缺。
原文摘要 · Abstract (English)
This paper investigates wearable-based recognition of human activities and gestures to support Human-Robot Interaction (HRI) in object-handover and assembly-like scenarios. Electromyography (EMG) and Inertial Measurement Unit (IMU) signals were collected using a Myo armband, culminating in a novel dataset introduced as MAGIC-HRI (Multimodal Activity, Gesture and Intention Collection) with a large taxonomy of 53 movement classes, including Brazilian Sign Language (LIBRAS) numbers (0-9), hand gestures, object/tool handover actions (pick up/give/hold), tool-manipulation tasks, and generic assembly/idle motions, collected from 11 participants with 10 samples per class (530 samples per participant). Signals are segmented by detecting muscle activation via an EMG energy envelope, then processed using sliding windows; time- and frequency-domain features are extracted. Multiple classical classifiers are tuned via cross-validated grid search, with Random Forest as the strongest baseline. A Leave-One-Subject-Out (LOSO) protocol reveals a large generalization gap, indicating substantial subject dependence. A personalized adaptation experiment suggests that injecting a small number of samples from a new user can markedly improve recognition. Overall, the study contributes a broad, HRI-driven multimodal dataset, a rigorous evaluation emphasizing generalization, and practical evidence that personalization is likely required for robust deployment in practical HRI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。