arXiv:2410.21059cs.RO2024-10被引 5

用视觉预测机械臂动作,智能选择移动机器人抓取方案。

Predictive Reachability for Embodiment Selection in Mobile Manipulation Behaviors

  • 基于世界模型预测未来动作,判断机械臂可达性
  • 在多种环境中提升样本效率与任务成功率
  • 无需逆运动学知识,仅靠图像观测即可决策

移动操作机器人需协调导航与操作完成任务。传统方法先移动基座靠近目标,再通过机械臂执行操作。以往方法依赖逆运动学求解来评估可达性,一旦有解即激活臂部动作。本文提出一种新方法——预测可达性,基于预测的臂部动作判断可达性。该方法采用基于世界模型的分层策略框架,世界模型可预测未来轨迹并评估可达性,分层策略据此选择执行体并规划行为。与依赖机器人和环境先验知识的逆运动学方法不同,本方法仅使用图像观测。我们在多种环境中的基础抓取任务上验证了该方法,结果表明其在样本效率和性能上均优于现有基于模型的方法,且能更合理地根据预测可达性进行执行体选择。

原文摘要 · Abstract (English)

Mobile manipulators require coordinated control between navigation and manipulation to accomplish tasks. Typically, coordinated mobile manipulation behaviors have base navigation to approach the goal followed by arm manipulation to reach the desired pose. Selecting the embodiment between the base and arm can be determined based on reachability. Previous methods evaluate reachability by computing inverse kinematics and activate arm motions once solutions are identified. In this study, we introduce a new approach called predictive reachability that decides reachability based on predicted arm motions. Our model utilizes a hierarchical policy framework built upon a world model. The world model allows the prediction of future trajectories and the evaluation of reachability. The hierarchical policy selects the embodiment based on the predicted reachability and plans accordingly. Unlike methods that require prior knowledge about robots and environments for inverse kinematics, our method only relies on image-based observations. We evaluate our approach through basic reaching tasks across various environments. The results demonstrate that our method outperforms previous model-based approaches in both sample efficiency and performance, while enabling more reasonable embodiment selection based on predictive reachability.

移动操作可达性预测视觉决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。