arXiv:2508.13151cs.ROcs.SY2025-08被引 2

让机器人先动一动再走,学会在移动前主动推开障碍物。

Manipulate-to-Navigate: Reinforcement Learning with Visual Affordances and Manipulability Priors

  • 结合操作性优先级与视觉线索,引导机器人选择有效动作。
  • 在仿真中成功完成推门和伸手定位任务,导航成功率提升明显。
  • 适合需要边操作边移动的复杂场景,如救援或家庭服务机器人。

动态环境中移动操作面临可移动障碍物阻挡路径的挑战。传统方法将导航与操作分离,难以应对需先操作后导航的情况。本文提出基于强化学习的方法,通过结合操作性先验(manipulability priors)聚焦于高操作性的身体位置,以及基于视觉的可操作性地图(affordance maps)筛选高质量操作动作,使机器人能高效选择可行且有意义的动作,减少无效探索。我们构建了两个新任务:'Reach'测试机器人能否在目标区选择合适手位,使基座前进同时末端保持不动;'Door'任务要求机器人推开障碍门以清出通行路径。两者均需先操作后导航。实验表明,该方法显著提升了机器人在动态环境中的交互与穿越能力。最后,我们将训练好的策略部署到真实的Boston Dynamics Spot机器人上,并成功完成'Reach'任务。

原文摘要 · Abstract (English)

Mobile manipulation in dynamic environments is challenging due to movable obstacles blocking the robot's path. Traditional methods, which treat navigation and manipulation as separate tasks, often fail in such 'manipulate-to-navigate' scenarios, as obstacles must be removed before navigation. In these cases, active interaction with the environment is required to clear obstacles while ensuring sufficient space for movement. To address the manipulate-to-navigate problem, we propose a reinforcement learning-based approach for learning manipulation actions that facilitate subsequent navigation. Our method combines manipulability priors to focus the robot on high manipulability body positions with affordance maps for selecting high-quality manipulation actions. By focusing on feasible and meaningful actions, our approach reduces unnecessary exploration and allows the robot to learn manipulation strategies more effectively. We present two new manipulate-to-navigate simulation tasks called Reach and Door with the Boston Dynamics Spot robot. The first task tests whether the robot can select a good hand position in the target area such that the robot base can move effectively forward while keeping the end effector position fixed. The second task requires the robot to move a door aside in order to clear the navigation path. Both of these tasks need first manipulation and then navigating the base forward. Results show that our method allows a robot to effectively interact with and traverse dynamic environments. Finally, we transfer the learned policy to a real Boston Dynamics Spot robot, which successfully performs the Reach task.

机器人操作强化学习动态环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。