arXiv:2508.00491cs.ROcs.AI2025-08中稿 · IEEE/RSJ Internati…被引 3

用模仿学习让假手在复杂环境抓取物体,减少用户负担。

HannesImitation: Grasping with the Hannes Prosthetic Hand via Imitation Learning

  • 通过模仿学习训练单个扩散策略控制假手
  • 在桌面、货架和人机交接场景中成功抓取多种物体
  • 相比传统视觉伺服方法,在无序环境中表现更优

近期假手控制研究聚焦于利用摄像头等传感器提升自主性,以降低用户认知负荷。在机器人领域,模仿学习已成为学习抓取与复杂操作任务的有力方法,且能简化数据收集。但其在假手控制中的应用仍很少被探索。为填补这一空白,本文提出HannesImitationPolicy,一种基于模仿学习的方法,用于控制Hannes假手,实现非结构化环境下的物体抓取。同时,我们构建了HannesImitationDataset,包含在桌面、货架及人机交接场景中的抓取示范数据。利用该数据集,训练单一扩散策略,部署于假手以预测手腕朝向和手部闭合动作。实验表明,该策略在多种物体与条件下均能成功抓取。此外,结果证明其在非结构化场景中优于基于分割的视觉伺服控制器。

原文摘要 · Abstract (English)

Recent advancements in control of prosthetic hands have focused on increasing autonomy through the use of cameras and other sensory inputs. These systems aim to reduce the cognitive load on the user by automatically controlling certain degrees of freedom. In robotics, imitation learning has emerged as a promising approach for learning grasping and complex manipulation tasks while simplifying data collection. Its application to the control of prosthetic hands remains, however, largely unexplored. Bridging this gap could enhance dexterity restoration and enable prosthetic devices to operate in more unconstrained scenarios, where tasks are learned from demonstrations rather than relying on manually annotated sequences. To this end, we present HannesImitationPolicy, an imitation learning-based method to control the Hannes prosthetic hand, enabling object grasping in unstructured environments. Moreover, we introduce the HannesImitationDataset comprising grasping demonstrations in table, shelf, and human-to-prosthesis handover scenarios. We leverage such data to train a single diffusion policy and deploy it on the prosthetic hand to predict the wrist orientation and hand closure for grasping. Experimental evaluation demonstrates successful grasps across diverse objects and conditions. Finally, we show that the policy outperforms a segmentation-based visual servo controller in unstructured scenarios. Additional material is provided on our project page: https://hsp-iit.github.io/HannesImitation

假手控制模仿学习抓取扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。