arXiv:2411.08566cs.ROcs.LG2024-11被引 2

用自编码器压缩抓取特征,让机器人更快学会抓不同物体。

Grammarization-Based Grasping with Deep Multi-Autoencoder Latent Space Exploration by Reinforcement Learning Agent

  • 三组自编码器压缩目标与夹爪特征,融合生成共同潜在空间。
  • 在模拟中使强化学习适应性提升超35%,抓取成功率高且计算开销小。
  • 适合研究机器人抓取、强化学习或低资源部署的开发者。

在非结构化环境中,机器人抓取面临物体几何形状、材质等多变因素的挑战。本文提出一种新框架:通过三个自编码器分别处理目标、夹爪及二者融合特征,将高维信息压缩至共享潜在空间。该设计使强化学习代理在新环境探索初期及零样本抓取尝试阶段获得更高学习效率。代理在第三个自编码器的潜在空间中进行探索,无需重建物体即可优化抓取质量。引入PoWER算法,在奖励加权的潜在空间中扰动更新策略,有效约束抓取位置与姿态完整性。在多样物体上评估显示,本方法显著提升抓取成功率,计算开销极低;模拟实验表明,代理适应能力提升超过35%。

原文摘要 · Abstract (English)

Grasping by a robot in unstructured environments is deemed a critical challenge because of the requirement for effective adaptation to a wide variation in object geometries, material properties, and other environmental factors. In this paper, we propose a novel framework for robotic grasping based on the idea of compressing high-dimensional target and gripper features in a common latent space using a set of autoencoders. Our approach simplifies grasping by using three autoencoders dedicated to the target, the gripper, and a third one that fuses their latent representations. This allows the RL agent to achieve higher learning rates at the initial stages of exploration of a new environment, as well as at non-zero shot grasp attempts. The agent explores the latent space of the third autoencoder for better quality grasp without explicit reconstruction of objects. By implementing the PoWER algorithm into the RL training process, updates on the agent's policy will be made through the perturbation in the reward-weighted latent space. The successful exploration efficiently constrains both position and pose integrity for feasible executions of grasps. We evaluate our system on a diverse set of objects, demonstrating the high success rate in grasping with minimum computational overhead. We found that approach enhances the adaptation of the RL agent by more than 35 % in simulation experiments.

机器人抓取强化学习自编码器潜在空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。