arXiv:2506.23152cs.RO2025-06ICCV被引 12

构建真实人机递物数据集,推动机器人灵巧抓取研究

DexH2R: A Benchmark for Dynamic Dexterous Grasping in Human-to-Robot Handover

  • 用遥操作采集真实人类动作,还原自然抓取行为
  • 涵盖多样物体与动态运动,提供高质量标注数据
  • 适配智能人形机器人,助力人机协作落地

人机之间灵巧手递物是人机协作中的基础但极具挑战的任务,需应对动态环境、多样化物体,并具备鲁棒自适应的抓取策略。然而,当前高效动态灵巧抓取方法的发展受限于缺乏高质量的真实世界人机递物数据集。现有数据集多聚焦静态物体或依赖合成递物动作,与真实机器人运动模式差异显著,导致应用脱节。本文提出DexH2R,一个基于灵巧机械手构建的综合性真实世界人机递物数据集。该数据集包含多种交互物体、动态运动模式、丰富的视觉传感器数据及详细标注。为确保动作自然且类人,采用遥操作采集数据,使机器人运动契合人类行为习惯,这对智能人形机器人至关重要。此外,我们提出一种有效解决方案DynamicGrasp,并评估了多种先进方法(包括自回归模型与扩散策略),提供全面对比分析。本基准有望通过高质量数据集、有效方案和完整评估指标,推动人机递物研究发展。

原文摘要 · Abstract (English)

Handover between a human and a dexterous robotic hand is a fundamental yet challenging task in human-robot collaboration. It requires handling dynamic environments and a wide variety of objects and demands robust and adaptive grasping strategies. However, progress in developing effective dynamic dexterous grasping methods is limited by the absence of high-quality, real-world human-to-robot handover datasets. Existing datasets primarily focus on grasping static objects or rely on synthesized handover motions, which differ significantly from real-world robot motion patterns, creating a substantial gap in applicability. In this paper, we introduce DexH2R, a comprehensive real-world dataset for human-to-robot handovers, built on a dexterous robotic hand. Our dataset captures a diverse range of interactive objects, dynamic motion patterns, rich visual sensor data, and detailed annotations. Additionally, to ensure natural and human-like dexterous motions, we utilize teleoperation for data collection, enabling the robot's movements to align with human behaviors and habits, which is a crucial characteristic for intelligent humanoid robots. Furthermore, we propose an effective solution, DynamicGrasp, for human-to-robot handover and evaluate various state-of-the-art approaches, including auto-regressive models and diffusion policy methods, providing a thorough comparison and analysis. We believe our benchmark will drive advancements in human-to-robot handover research by offering a high-quality dataset, effective solutions, and comprehensive evaluation metrics.

人机协作灵巧抓取数据集遥操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。