arXiv:2606.07389cs.RO2026-06

用仿真自动生成假肢抓取数据,无需肌电信号也能高效学习

Simulation-Driven Imitation Learning for Biosignals-Free Shared-Autonomy Prosthetic Grasping

论文配图:Simulation-Driven Imitation Learning for Biosignals-Free Shared-Autonomy Prosthetic Grasping
图 1 · 摘自论文原文
  • 通过虚拟腕部摄像头自动合成真实感抓取动作
  • 模拟数据训练的策略在真实场景中抓取成功率超90%
  • 适合研究假肢控制与仿真实验的开发者

无生物信号的上肢假肢共享自主控制旨在不依赖肌电(EMG)等生理信号的情况下实现自然、低负担的操作。近期基于模仿学习的方法虽有进展,但因收集大量真实人类示范数据成本高、差异大而难以扩展。本文提出一种可扩展的仿真框架,能从腕部安装的虚拟相机自动生成多样化的伸手-抓取示范。该框架结合物理可行的抓握生成、自然伸手轨迹重定向,以及在程序化生成的室内环境中执行伸手-抓取-举起动作。系统记录腕部视角观测、本体感觉和操作动作,构建大规模示范数据集用于模仿学习。通过广泛的仿真基准测试,评估了物体与场景泛化能力,并对比了多种先进模仿学习方法。结果表明,仿真生成的示范足够丰富且一致,可有效支持策略学习。在三个真实场景中,所学的“仿真到现实”策略抓取成功率超过90%,优于基线方法,展现出更强泛化能力,验证了仿真驱动训练在无生物信号共享自主假肢抓取中的潜力。示范数据已公开于 https://sites.google.com/view/sim-prosthetic-grasp/home。

原文摘要 · Abstract (English)

Biosignals-free shared-autonomy control of upper-limb prosthetic hands aims to enable natural and low-effort manipulation without relying on EMG or other physiological signals. Recent imitation-learning-based approaches have shown promising results, but their scalability is limited by the cost and variability of collecting large amounts of real-world human demonstration data. In this work, we present a scalable simulation framework that automatically generates diverse reach-to-grasp demonstrations from a wrist-mounted virtual camera. The framework combines physically feasible grasp synthesis, natural reaching trajectories retargeting, and reach--grasp--lift execution in procedurally generated indoor environments. It records wrist-view observations, proprioception, and actions to build a large-scale demonstration dataset for imitation learning. Through extensive simulation benchmarks, we evaluate object and scene generalization and compare several representative state-of-the-art imitation learning methods. Results show that the simulated demonstrations are sufficiently rich and consistent for effective policy learning. In three realistic settings, the learned sim-to-real policy achieves over 90\% grasp success, surpasses baseline methods, and exhibits stronger generalization, highlighting the promise of simulation-driven training for biosignals-free shared-autonomy prosthetic grasping. The demonstrations are available at \href{https://sites.google.com/view/sim-prosthetic-grasp/home}{https://sites.google.com/view/sim-prosthetic-grasp/home}.

假肢控制仿真训练模仿学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。