arXiv:2504.01888cs.ROcs.AI2025-04被引 2

用摄像头手势控制下肢外骨骼,提升康复训练舒适度与响应速度。

A novel gesture interaction control method for rehabilitation lower extremity exoskeleton

  • 基于单目视觉的非接触手势识别,融合关键点检测与距离评估
  • 手势控制精度达94.11%,系统平均响应时间仅0.615秒
  • 适合注重自然交互体验的康复患者及外骨骼研发者

随着康复下肢外骨骼(RLEEX)技术的快速发展,人机交互(HRI)方法取得了显著进展,包括易识别的传统物理交互方式以及可可视化预测动作的生物电信号交互方法。然而,这些方法多为接触式,存在操作复杂、易受干扰、植入设备风险高及舒适性差等问题,导致交互不自然,影响患者康复积极性。为此,本文提出一种基于RGB单目相机深度估计的新型非接触手势交互控制方法。该方法包含关键点检测、手势识别与距离评估三个核心步骤,结合手势信息与增强现实触发技术,实现对RLEEX步态运动的控制。实验结果表明,该方法在非接触交互下实现了94.11%的运动控制精度和0.615秒的平均系统响应时间,有效解决了现有RLEEX平台交互中舒适性差、可靠性低、延迟高等问题。该非接触式人机交互方法为下肢外骨骼控制交互提供了开创性解决方案,推动该领域进一步发展。

原文摘要 · Abstract (English)

With the rapid development of Rehabilitation Lower Extremity Robotic Exoskeletons (RLEEX) technology, significant advancements have been made in Human-Robot Interaction (HRI) methods. These include traditional physical HRI methods that are easily recognizable and various bio-electrical signal-based HRI methods that can visualize and predict actions. However, most of these HRI methods are contact-based, facing challenges such as operational complexity, sensitivity to interference, risks associated with implantable devices, and, most importantly, limitations in comfort. These challenges render the interaction less intuitive and natural, which can negatively impact patient motivation for rehabilitation. To address these issues, this paper proposes a novel non-contact gesture interaction control method for RLEEX, based on RGB monocular camera depth estimation. This method integrates three key steps: detecting keypoints, recognizing gestures, and assessing distance, thereby applying gesture information and augmented reality triggering technology to control gait movements of RLEEX. Results indicate that this approach provides a feasible solution to the problems of poor comfort, low reliability, and high latency in HRI for RLEEX platforms. Specifically, it achieves a gesture-controlled exoskeleton motion accuracy of 94.11\% and an average system response time of 0.615 seconds through non-contact HRI. The proposed non-contact HRI method represents a pioneering advancement in control interactions for RLEEX, paving the way for further exploration and development in this field.

外骨骼手势控制非接触交互康复机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。