arXiv:2606.29423cs.LG2026-06中稿 · ACII2025

用肌电图提前800毫秒预判石头剪刀布手势,可提升人机交互速度

Temporal Posed and Spontaneous Gesture Recognition from Electromyography in the Rock-Paper-Scissors Game

论文配图:Temporal Posed and Spontaneous Gesture Recognition from Electromyography in the Rock-Paper-Scissors Game
图 1 · 摘自论文原文
  • 通过双通道肌电图捕捉动作前的肌肉激活信号
  • 手势可见前800毫秒即可检测到肌电信号,峰值在342毫秒前
  • 能从对手肌电预测其手势,准确率达65%,适合实时交互应用

手势识别在需实时响应的领域中至关重要,尤其在多人场景下要求快速识别。本文研究了在石头剪刀布游戏中肌电图(EMG)的时间特性及其手势识别精度。24名参与者以双人对战形式进行游戏,同时记录前臂双通道肌电图。结果发现,肌电起始可提前至少800毫秒被检测到,峰值出现在可见动作前约342毫秒。在姿态化与自发手势条件下评估自手势识别,姿态手势平均准确率为63.4%;使用姿态数据训练的模型在自发手势上准确率为53.6%,个体间差异显著。还测试了从对手肌电中推断其手势的可能性,最高平均准确率达65%,在视觉动作出现后2082毫秒达到峰值。这表明对手对观察到手势的反应中包含可观测手势的信息,源于互动动态。肌电信号在动作前激活的时序优势,为需要快速意图识别的应用(如人机交互、辅助技术)提供了潜力。未来工作应聚焦于优化起始点检测并降低自发运动变异的影响,以提升复杂真实环境下的识别性能。

原文摘要 · Abstract (English)

The importance of gesture recognition has been acknowledged in many domains requiring real-time recognition systems. Two requirements for these are fast recognition in multiuser contexts. Therefore, we explored the temporal characteristics of electromyography (EMG) and its accuracy in recognizing gestures in a Rock-Paper-Scissors (RPS) game. Twenty-four participants played RPS in dyads, while a two-channel EMG was recorded from the forearm. We found out that EMG onsets could be detected at least 800 ms before the gesture's visible onset, and that the EMG peaks around 342 ms before the visible onset of the gesture. Furthermore, we evaluated self-gesture recognition in both posed and spontaneous gesture conditions. The mean accuracy for posed gestures reached 63.4%. The model trained on posed gestures achieved 53.6% for spontaneous gestures, with considerable variation across individuals. We also checked whether detecting a player's gesture from the opponent's EMG was possible. The peak mean accuracy was 65%, peaking at 2082 ms after the visual onset of the gesture. This suggests that the opponent's reaction to an observed gesture contains information about the observed gesture due to the dynamics of the interactions while playing. The temporal predictive advantage of EMG signals, where muscle activation precedes observable movement, offers potential benefits for applications requiring rapid intent recognition, such as human-computer interaction and assistive technologies. Future work should focus on refining onset detection and reducing the impact of spontaneous movement variability across conditions to improve recognition performance in dynamic and real-world environments.

肌电图手势识别实时交互意图预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。