arXiv:2412.04052cs.RO2024-12被引 10

双臂协同推移抓取,让机械臂在密集杂物中更灵活地抓物。

Learning Dual-Arm Push and Grasp Synergy in Dense Clutter

  • 分层强化学习框架,结合视觉特征提取与模糊奖励函数。
  • 在模拟和真实机器人上实现6自由度抓取,成功率显著提升。
  • 适合需要高灵巧操作的复杂场景任务,如仓储分拣。

在密集杂乱环境中,机器人抓取面临可用无碰撞抓取位置稀缺的挑战。非握持动作可增加可行抓取机会,但多数研究聚焦单臂而非双臂操作。单臂策略难以充分发挥双臂协同优势。本文提出一种面向目标的分层深度强化学习框架,学习双臂推-抓协同策略,以增强复杂环境下的灵巧操作能力。该框架通过预训练深度学习主干网络与新型基于CNN的DRL模型,结合近端策略优化(PPO)算法,将视觉观测映射为动作。主干网络提升密集杂乱环境中的特征表示能力,引入新型基于模糊逻辑的奖励函数,加速策略学习。系统在Isaac Gym中开发并训练,随后在仿真与真实机器人上测试。实验表明,本框架能有效将视觉数据映射为双臂推-抓动作,使双臂系统在复杂环境中成功抓取目标物体。相比现有方法,本方案生成6-DoF抓取候选,并支持双臂推动作,模仿人类行为,高效完成密集杂乱环境下的任务。

原文摘要 · Abstract (English)

Robotic grasping in densely cluttered environments is challenging due to scarce collision-free grasp affordances. Non-prehensile actions can increase feasible grasps in cluttered environments, but most research focuses on single-arm rather than dual-arm manipulation. Policies from single-arm systems fail to fully leverage the advantages of dual-arm coordination. We propose a target-oriented hierarchical deep reinforcement learning (DRL) framework that learns dual-arm push-grasp synergy for grasping objects to enhance dexterous manipulation in dense clutter. Our framework maps visual observations to actions via a pre-trained deep learning backbone and a novel CNN-based DRL model, trained with Proximal Policy Optimization (PPO), to develop a dual-arm push-grasp strategy. The backbone enhances feature mapping in densely cluttered environments. A novel fuzzy-based reward function is introduced to accelerate efficient strategy learning. Our system is developed and trained in Isaac Gym and then tested in simulations and on a real robot. Experimental results show that our framework effectively maps visual data to dual push-grasp motions, enabling the dual-arm system to grasp target objects in complex environments. Compared to other methods, our approach generates 6-DoF grasp candidates and enables dual-arm push actions, mimicking human behavior. Results show that our method efficiently completes tasks in densely cluttered environments. https://sites.google.com/view/pg4da/home

双臂操作强化学习抓取复杂环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。