用演示编辑强化学习,实现任意物体的通用灵巧功能抓取。
Universal Dexterous Functional Grasping via Demonstration-Editing Reinforcement Learning
- 将抓取风格与功能属性解耦,通过单次示范实现高效多任务学习。
- 在仿真与真实场景中均成功泛化到未见物体重构组合,成功率显著提升。
- 结合视觉语言模型,可自主理解指令完成抓取,适合复杂操作场景。
强化学习在灵巧抓取中取得显著进展,大幅提升了从仿真到现实世界的泛化能力。然而,对下游操作任务至关重要的精细功能抓取仍研究不足,面临目标与奖励函数设定复杂、多任务探索困难及仿真到现实迁移挑战。本文提出DemoFunGrasp,将功能抓取条件分解为抓取风格与可用性两个互补成分,并融入强化学习框架,可学习以任意功能条件抓取任意物体。为解决多任务优化难题,仅需一次抓取示范,将强化学习问题重构为一步示范编辑,极大提升样本效率与性能。仿真与真实世界实验表明,DemoFunGrasp能泛化至未见的物体-功能-抓取风格组合,在成功率与功能抓取准确率上优于基线方法。此外,通过引入视觉语言模型(VLM)进行规划,系统具备自主指令跟随抓取执行能力,兼具强仿真实现与真实部署表现。
原文摘要 · Abstract (English)
Reinforcement learning (RL) has achieved great success in dexterous grasping, significantly improving grasp performance and generalization from simulation to the real world. However, fine-grained functional grasping, which is essential for downstream manipulation tasks, remains underexplored and faces several challenges: the complexity of specifying goals and reward functions for functional grasps across diverse objects, the difficulty of multi-task RL exploration, and the challenge of sim-to-real transfer. In this work, we propose DemoFunGrasp for universal dexterous functional grasping. We factorize functional grasping conditions into two complementary components - grasping style and affordance - and integrate them into an RL framework that can learn to grasp any object with any functional grasping condition. To address the multi-task optimization challenge, we leverage a single grasping demonstration and reformulate the RL problem as one-step demonstration editing, substantially enhancing sample efficiency and performance. Experimental results in both simulation and the real world show that DemoFunGrasp generalizes to unseen combinations of objects, affordances, and grasping styles, outperforming baselines in both success rate and functional grasping accuracy. In addition to strong sim-to-real capability, by incorporating a vision-language model (VLM) for planning, our system achieves autonomous instruction-following grasp execution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。