构建舞蹈教学的迟疑动作数据集,助力机器人更自然地表达犹豫姿态。
Dance2Hesitate: A Multi-Modal Dataset of Dancer-Taught Hesitancy for Understandable Robot Motion
- 用舞者模仿机器人动作,生成三类迟疑程度的多模态数据。
- 涵盖70条全身轨迹、84条上肢轨迹和66条教学轨迹,覆盖三种迟疑等级。
- 适合人机协作、机器人行为理解与可解释性研究者使用。
在人机协作中,机器人的迟疑表达会影响人类的协调策略、注意力分配和安全判断。但设计具有泛化能力的迟疑动作仍具挑战,因观察者的理解高度依赖身体形态与情境。为此,我们提出并开源一个由舞者生成的多模态迟疑动作数据集,聚焦特定情境-形态组合:机械臂/人类上肢靠近积木塔,以及拟人化全身动作在自由空间中的表现。数据集包含(i)Franka Emika Panda机器人从固定起点到积木塔目标点,以三种迟疑等级(轻微、显著、极端)进行的运动教学示范;(ii)同步采集的舞者上肢动作(三类迟疑等级)与极端迟疑下的完整人体动作序列。所有数据均附带文档,支持跨机器人与人类模态的可复现基准测试。共收集70条全身轨迹、84条上肢轨迹及66条教学轨迹,覆盖三类迟疑水平。数据集可访问:https://brsrikrishna.github.io/Dance2Hesitate/
原文摘要 · Abstract (English)
In human-robot collaboration, a robot's expression of hesitancy is a critical factor that shapes human coordination strategies, attention allocation, and safety-related judgments. However, designing hesitant robot motion that generalizes is challenging because the observer's inference is highly dependent on embodiment and context. To address these challenges, we introduce and open-source a multi-modal, dancer-generated dataset of hesitant motion where we focus on specific context-embodiment pairs (i.e., manipulator/human upper-limb approaching a Jenga Tower, and anthropomorphic whole body motion in free space). The dataset includes (i) kinesthetic teaching demonstrations on a Franka Emika Panda reaching from a fixed start configuration to a fixed target (a Jenga tower) with three graded hesitancy levels (slight, significant, extreme) and (ii) synchronized RGB-D motion capture of dancers performing the same reaching behavior using their upper limb across three hesitancy levels, plus full human body sequences for extreme hesitancy. We further provide documentation to enable reproducible benchmarking across robot and human modalities. Across all dancers, we obtained 70 unique whole-body trajectories, 84 upper limb trajectories spanning over the three hesitancy levels, and 66 kinesthetic teaching trajectories spanning over the three hesitancy levels. The dataset can be accessed here: https://brsrikrishna.github.io/Dance2Hesitate/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。