arXiv:2608.16351cs.RO2026-08被引 1

用预训练模型生成符合机械臂约束的抓取,效率更高更通用。

Arm-Aware Guided Dexterous Grasp Generation with Arm-Agnostic Grasp Models

论文配图:Arm-Aware Guided Dexterous Grasp Generation with Arm-Agnostic Grasp Models
图 1 · 摘自论文原文
  • 推理时融合机械臂与环境信息,不需重训练
  • 在6种场景下10,000个物体中显著提升可行抓取率
  • 适合真实世界多机器人、复杂环境下的抓取应用

考虑机械臂相关约束的灵巧抓取生成在现实场景中至关重要,涉及避障、工作空间边界抓取及连续抓取。现有以手为中心的抓取模型主要关注浮空手姿态,无法满足此类需求。传统方法或依赖拒绝采样丢弃不可行样本,或需在特定机械臂数据上重新训练,导致在不利条件下样本效率低且跨机器人泛化能力差。本文提出一种机械臂感知的灵巧抓取生成框架,利用预训练的无臂抓取模型,并仅在推理时融入机械臂与环境信息。具体地,将机械臂约束抓取生成建模为手姿态与机械臂配置的联合优化,推导出机械臂相关约束的闭式梯度。假设手姿态分布由扩散模型表示,证明基于梯度的优化等价于引导扩散采样,可将近可行样本引导至可行区域。通过覆盖6种场景的10,000个物体的综合评估,验证该框架在高度约束环境下显著提高可行抓取概率,凸显其在真实应用中的优势。

原文摘要 · Abstract (English)

Dexterous grasp generation that considers arm-related constraints is crucial in real-world scenarios involving arm environment collision avoidance, workspace boundary grasps, and consecutive grasping. Existing hand-centric grasp models, which primarily focus on the floating hand's pose, are insufficient for such cases. Conventional arm-aware methods either rely on rejection sampling to discard infeasible samples or require retraining on arm-specific data, leading to low sample efficiency under adverse conditions or limited generalization across different robots and environments. To overcome these limitations, this letter presents an arm-aware dexterous grasp generation framework that leverages pretrained arm-agnostic grasp models while integrating arm and environmental information only at inference time. Specifically, we formulate arm-aware constrained grasp generation as a joint optimization of hand pose and arm configuration, and derive closed-form gradients for arm-related constraints. Assuming the hand pose distribution is represented by a diffusion model, we prove that gradient-based optimization is equivalent to guided diffusion sampling, steering near-feasible samples toward the feasible region. Through comprehensive evaluation involving 10k objects across 6 scenarios, we demonstrate that the proposed framework generates feasible grasps in highly constrained settings with significantly higher probability, highlighting its advantages in real-world applications. Supplementary materials and appendix are available at https://arm-aware-dexgrasp.github.io/.

灵巧抓取机械臂约束扩散模型高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。