无需肌电信号,仅靠手腕摄像头实现假肢手自动抓取与释放。
Towards Biosignals-Free Autonomous Prosthetic Hand Control via Imitation Learning
- 通过模仿学习,从人类示范中训练假肢手自主控制策略。
- 在少量物体数据上训练后,对新用户和未知物体抓取成功率高。
- 适合希望简化控制、降低心理负担的截肢患者使用。
肢体缺失影响全球数百万人,严重损害身体功能并降低生活质量。传统表面肌电(sEMG)和半自主控制方法要求用户为每次操作生成肌电信号,带来身心双重负担。本研究旨在开发一种完全自主的控制方案,仅需佩戴在腕部的摄像头,即可让假肢手自动识别并抓取不同形状的物体。将手靠近物体时,系统会根据手部动作与环境信息自动执行合适力度的抓取;松开物体时,只需将其自然放置于桌面,系统便会自动张开手指。为实现该目标,我们构建了远程操控系统,采集人类示范数据用于模仿学习,使假肢手动作复现人类行为。仅基于单名参与者演示的有限物体数据进行训练,模型即展现出高成功率,并能有效泛化至新用户及未见过的物体(包括不同重量)。示范数据已公开于 https://sites.google.com/view/autonomous-prosthetic-hand。
原文摘要 · Abstract (English)
Limb loss affects millions globally, impairing physical function and reducing quality of life. Most traditional surface electromyographic (sEMG) and semi-autonomous methods require users to generate myoelectric signals for each control, imposing physically and mentally taxing demands. This study aims to develop a fully autonomous control system that enables a prosthetic hand to automatically grasp and release objects of various shapes using only a camera attached to the wrist. By placing the hand near an object, the system will automatically execute grasping actions with a proper grip force in response to the hand's movements and the environment. To release the object being grasped, just naturally place the object close to the table and the system will automatically open the hand. Such a system would provide individuals with limb loss with a very easy-to-use prosthetic control interface and may help reduce mental effort while using. To achieve this goal, we developed a teleoperation system to collect human demonstration data for training the prosthetic hand control model using imitation learning, which mimics the prosthetic hand actions from human. By training the model on data from a limited set of objects collected from a single participant's demonstration, we showed that the imitation learning algorithm can achieve high success rates and generalize effectively to new users and previously unseen objects with varying weights. The demonstrations are available at https://sites.google.com/view/autonomous-prosthetic-hand.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。