让机器人抓取更像人,兼顾自然姿势与物体功能。
Towards Affordance-Aware Robotic Dexterous Grasping with Human-like Priors
- 两阶段训练:先学人类动作模式,再微调适应具体物体。
- 在未见物体上抓取成功率超基线,且接触位置合理。
- 适合需要自然抓取的通用机器人任务,如家务或工业操作。
具备泛化抓取能力的手部是通用具身人工智能发展的基础。然而,以往方法仅关注低层抓取稳定性,忽视了功能适配的位置和类人姿态,这对后续操作至关重要。为此,我们提出AffordDex框架,采用两阶段训练,学习一种具有运动先验和物体功能感知能力的通用抓取策略。第一阶段,在大规模人类手部动作数据上预训练轨迹模仿器,引入自然运动先验;第二阶段,通过残差模块将通用类人动作适配到具体物体实例,该过程由负向功能不适配分割(NAA)模块和教师-学生知识蒸馏共同指导,确保最终视觉策略高成功率。大量实验表明,AffordDex不仅实现通用灵巧抓取,且姿态高度类人、接触位置功能合理,在已见物体、未见实例及全新类别上均显著优于现有最优基线。
原文摘要 · Abstract (English)
A dexterous hand capable of generalizable grasping objects is fundamental for the development of general-purpose embodied AI. However, previous methods focus narrowly on low-level grasp stability metrics, neglecting affordance-aware positioning and human-like poses which are crucial for downstream manipulation. To address these limitations, we propose AffordDex, a novel framework with two-stage training that learns a universal grasping policy with an inherent understanding of both motion priors and object affordances. In the first stage, a trajectory imitator is pre-trained on a large corpus of human hand motions to instill a strong prior for natural movement. In the second stage, a residual module is trained to adapt these general human-like motions to specific object instances. This refinement is critically guided by two components: our Negative Affordance-aware Segmentation (NAA) module, which identifies functionally inappropriate contact regions, and a privileged teacher-student distillation process that ensures the final vision-based policy is highly successful. Extensive experiments demonstrate that AffordDex not only achieves universal dexterous grasping but also remains remarkably human-like in posture and functionally appropriate in contact location. As a result, AffordDex significantly outperforms state-of-the-art baselines across seen objects, unseen instances, and even entirely novel categories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。