arXiv:2503.00508cs.RO2025-03被引 8

用人类示范引导扩散模型,一步生成高效稳定的6自由度抓取。

HGDiffuser: Efficient Task-Oriented Grasp Generation via Human-Guided Grasp Diffusion Models

  • 将任务约束融入扩散过程,单阶段生成6-DoF抓取。
  • 相比两阶段方法效率提升显著,成功率更高。
  • 适合需要快速迁移人类抓取策略的机器人系统。

任务导向抓取(TOG)对机器人执行操作任务至关重要,需生成既稳定又符合任务约束的抓取。人类在实际操作中会根据任务自然调整抓取方式。现有方法通过人类抓取示范生成高质量的平行夹爪抓取,但面临抓取稳定性与采样效率不足的问题。这些方法通常采用两阶段流程:先在6-自由度空间中进行全范围的任务无关抓取采样,再用示范引入的约束(如接触区域和腕部朝向)筛选候选。这导致效率低下且易失败。为此,我们提出人机引导抓取扩散模型(HGDiffuser),一种基于扩散框架的方法,将任务约束整合进引导采样过程。该方法可直接单阶段生成6-自由度任务导向抓取,避免了耗时的全局采样。此外,通过引入扩散变压器(DiT)作为特征骨干,相较于基于MLP的方法,显著提升了抓取生成质量。实验表明,本方法显著提升了任务导向抓取生成效率,更有效地将人类抓取策略迁移到机器人系统。源代码与补充视频请访问 https://sites.google.com/view/hgdiffuser。

原文摘要 · Abstract (English)

Task-oriented grasping (TOG) is essential for robots to perform manipulation tasks, requiring grasps that are both stable and compliant with task-specific constraints. Humans naturally grasp objects in a task-oriented manner to facilitate subsequent manipulation tasks. By leveraging human grasp demonstrations, current methods can generate high-quality robotic parallel-jaw task-oriented grasps for diverse objects and tasks. However, they still encounter challenges in maintaining grasp stability and sampling efficiency. These methods typically rely on a two-stage process: first performing exhaustive task-agnostic grasp sampling in the 6-DoF space, then applying demonstration-induced constraints (e.g., contact regions and wrist orientations) to filter candidates. This leads to inefficiency and potential failure due to the vast sampling space. To address this, we propose the Human-guided Grasp Diffuser (HGDiffuser), a diffusion-based framework that integrates these constraints into a guided sampling process. Through this approach, HGDiffuser directly generates 6-DoF task-oriented grasps in a single stage, eliminating exhaustive task-agnostic sampling. Furthermore, by incorporating Diffusion Transformer (DiT) blocks as the feature backbone, HGDiffuser improves grasp generation quality compared to MLP-based methods. Experimental results demonstrate that our approach significantly improves the efficiency of task-oriented grasp generation, enabling more effective transfer of human grasping strategies to robotic systems. To access the source code and supplementary videos, visit https://sites.google.com/view/hgdiffuser.

抓取生成扩散模型机器人操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。