arXiv:2504.05983cs.RO2025-04被引 4

柔性可穿戴手套实现高精度手势识别与动态手部建模

Modular Soft Wearable Glove for Real-Time Gesture Recognition and Dynamic 3D Shape Reconstruction

  • 采用线电极+液态金属传感器,分关节捕捉手指弯曲与指间间距变化
  • 99.15%手势识别准确率,手部三维重建平均误差仅2.076毫米
  • 模块化设计适配人体结构,适合虚拟现实与康复医疗场景

随着人机交互需求增长,柔性可穿戴手套在虚拟现实、医疗康复和工业自动化中展现出广阔前景。然而现有技术仍存在灵敏度不足与耐用性差等问题。本文提出一种基于线状电极与液态金属(EGaIn)的高灵敏度、模块化柔性电容传感器,集成于贴合人体手部解剖结构的传感模块中。系统独立采集各指关节弯曲信息,并通过相邻指间间距测量记录细微变化,结合点云实现复杂动作的手势识别与动态手部形态重建。实验表明,基于卷积神经网络(CNN)与多层感知机(MLP)的分类器在30种手势上达到99.15%准确率;基于Transformer的深度神经网络重建平均距离为2.076±3.231毫米,关键点精度超越当前最优方法9.7%至64.9%。该手套在手势识别与手部重建中表现出优异的准确性、鲁棒性与可扩展性,是下一代人机交互系统的有力候选。

原文摘要 · Abstract (English)

With the increasing demand for human-computer interaction (HCI), flexible wearable gloves have emerged as a promising solution in virtual reality, medical rehabilitation, and industrial automation. However, the current technology still has problems like insufficient sensitivity and limited durability, which hinder its wide application. This paper presents a highly sensitive, modular, and flexible capacitive sensor based on line-shaped electrodes and liquid metal (EGaIn), integrated into a sensor module tailored to the human hand's anatomy. The proposed system independently captures bending information from each finger joint, while additional measurements between adjacent fingers enable the recording of subtle variations in inter-finger spacing. This design enables accurate gesture recognition and dynamic hand morphological reconstruction of complex movements using point clouds. Experimental results demonstrate that our classifier based on Convolution Neural Network (CNN) and Multilayer Perceptron (MLP) achieves an accuracy of 99.15% across 30 gestures. Meanwhile, a transformer-based Deep Neural Network (DNN) accurately reconstructs dynamic hand shapes with an Average Distance (AD) of 2.076\pm3.231 mm, with the reconstruction accuracy at individual key points surpassing SOTA benchmarks by 9.7% to 64.9%. The proposed glove shows excellent accuracy, robustness and scalability in gesture recognition and hand reconstruction, making it a promising solution for next-generation HCI systems.

可穿戴设备手势识别三维重建柔性传感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。