arXiv:2503.04635cs.ROcs.CV2025-03被引 2

用真人互动数据训练机器人手部交接,让额外机械臂更自然地协助人类。

3HANDS Dataset: Learning from Humans for Generating Naturalistic Handovers with Supernumerary Robotic Limbs

  • 采集真人与附加机械臂的真实交接动作数据
  • 生成的交接动作被用户评价更自然、更省力
  • 适合研究人机协作与可穿戴机器人交互的团队

附加机器人肢体(SRLs)是紧贴人体集成的机器人结构,能增强人类物理能力,要求人机交互无缝自然。为有效辅助物理任务,使SRL向人类传递物体至关重要。传统基于启发式策略的设计耗时长、泛化性差,且动作不自然。通过高质量数据集训练生成模型,可替代传统方法。本文提出3HANDS数据集,记录参与者在日常活动中,一人扮演髋部携带的SRL,与另一人进行自然交接的互动过程。该数据集捕捉了SRL交互的独特特征:在亲密个人空间内操作、物体来源不对称、隐含运动同步,以及用户在交接中仍专注于主任务。为验证数据集有效性,我们构建三个模型:生成自然交接轨迹、确定合适交接终点、预测最佳交接时机。用户研究(N=10)显示,相比基线方法,本方法显著提升交接自然度、降低身体负担、提升舒适感。

原文摘要 · Abstract (English)

Supernumerary robotic limbs (SRLs) are robotic structures integrated closely with the user's body, which augment human physical capabilities and necessitate seamless, naturalistic human-machine interaction. For effective assistance in physical tasks, enabling SRLs to hand over objects to humans is crucial. Yet, designing heuristic-based policies for robots is time-consuming, difficult to generalize across tasks, and results in less human-like motion. When trained with proper datasets, generative models are powerful alternatives for creating naturalistic handover motions. We introduce 3HANDS, a novel dataset of object handover interactions between a participant performing a daily activity and another participant enacting a hip-mounted SRL in a naturalistic manner. 3HANDS captures the unique characteristics of SRL interactions: operating in intimate personal space with asymmetric object origins, implicit motion synchronization, and the user's engagement in a primary task during the handover. To demonstrate the effectiveness of our dataset, we present three models: one that generates naturalistic handover trajectories, another that determines the appropriate handover endpoints, and a third that predicts the moment to initiate a handover. In a user study (N=10), we compare the handover interaction performed with our method compared to a baseline. The findings show that our method was perceived as significantly more natural, less physically demanding, and more comfortable.

人机交互机器人协同动作生成附加肢体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。