arXiv:2502.00275cs.ROcs.CV2025-02

用前臂超声图同时估出手部动作和抓握力,提升机器人远程操控精度。

Simultaneous Estimation of Manipulation Skill and Hand Grasp Force from Forearm Ultrasound Images

  • 基于前臂超声数据,用深度学习同步估计手部动作与抓握力。
  • 动作分类准确率94.87%,力估计均方根误差0.51牛,五折交叉验证。
  • 适用于高精度人机协作、远程操作与技能迁移场景。

精确估计人体手部构型及施加力对实现有效的机器人遥操作与技能迁移至关重要。深入理解人与物体的交互可进一步提升遥操作性能。为此,研究者探索了将人类操作技能与作用力转化为机器人系统的途径。其中,基于生物信号的方法,特别是利用前臂超声数据,已在估计手部运动与手指力方面展现出巨大潜力。本研究提出一种方法,通过前臂超声图像同时估计操纵技能与手部抓握力。数据来自七名参与者,用于训练深度学习模型以分类操纵技能并估计抓握力。经五折交叉验证,模型在技能分类上平均准确率达94.87%±10.16%,力估计的平均均方根误差(RMSE)为0.51±0.19牛。结果表明,前臂超声在推进人机接口与复杂操纵任务的机器人遥操作方面具有显著效果。该工作为人类-机器人技能迁移与遥操作开辟了新路径,弥合了人类灵巧性与机器人控制之间的差距。

原文摘要 · Abstract (English)

Accurate estimation of human hand configuration and the forces they exert is critical for effective teleoperation and skill transfer in robotic manipulation. A deeper understanding of human interactions with objects can further enhance teleoperation performance. To address this need, researchers have explored methods to capture and translate human manipulation skills and applied forces to robotic systems. Among these, biosignal-based approaches, particularly those using forearm ultrasound data, have shown significant potential for estimating hand movements and finger forces. In this study, we present a method for simultaneously estimating manipulation skills and applied hand force using forearm ultrasound data. Data collected from seven participants were used to train deep learning models for classifying manipulation skills and estimating grasp force. Our models achieved an average classification accuracy of 94.87 percent plus or minus 10.16 percent for manipulation skills and an average root mean square error (RMSE) of 0.51 plus or minus 0.19 Newtons for force estimation, as evaluated using five-fold cross-validation. These results highlight the effectiveness of forearm ultrasound in advancing human-machine interfacing and robotic teleoperation for complex manipulation tasks. This work enables new and effective possibilities for human-robot skill transfer and tele-manipulation, bridging the gap between human dexterity and robotic control.

遥操作超声感知技能迁移力估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。