用腕臂肌群微动信号实现手势识别,效果媲美肌电
A Comparative Study of EMG- and IMU-based Gesture Recognition at the Wrist and Forearm
- 通过腕臂处的惯性传感器捕捉肌肉微运动信号
- 单靠IMU信号即可准确识别静态手势
- 适合假肢控制与人机交互场景
手势是日常人机交互的重要方式。手部手势识别(HGR)通过视觉数据或生物信号等输入模态解析人类意图。生物信号因可非侵入式采集而广泛应用于HGR,其中表面肌电(sEMG)研究最深入。但惯性测量单元(IMU)能捕捉细微肌肉运动,具有互补价值。本研究探索不同肌群的IMU信号在手势识别中的潜力。结果表明,仅用IMU信号即可实现静态手势识别;不同肌群间识别性能存在差异;且腱-骨微位移是静态手势识别的主要信息来源。该方法有望提升截肢者假肢的可用性,并为机器人操控、远程操作、手语识别等领域提供新思路。
原文摘要 · Abstract (English)
Gestures are an integral part of our daily interactions with the environment. Hand gesture recognition (HGR) is the process of interpreting human intent through various input modalities, such as visual data (images and videos) and bio-signals. Bio-signals are widely used in HGR due to their ability to be captured non-invasively via sensors placed on the arm. Among these, surface electromyography (sEMG), which measures the electrical activity of muscles, is the most extensively studied modality. However, less-explored alternatives such as inertial measurement units (IMUs) can provide complementary information on subtle muscle movements, which makes them valuable for gesture recognition. In this study, we investigate the potential of using IMU signals from different muscle groups to capture user intent. Our results demonstrate that IMU signals contain sufficient information to serve as the sole input sensor for static gesture recognition. Moreover, we compare different muscle groups and check the quality of pattern recognition on individual muscle groups. We further found that tendon-induced micro-movement captured by IMUs is a major contributor to static gesture recognition. We believe that leveraging muscle micro-movement information can enhance the usability of prosthetic arms for amputees. This approach also offers new possibilities for hand gesture recognition in fields such as robotics, teleoperation, sign language interpretation, and beyond.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。