用图神经网络和强化学习实现多机器人无碰撞运动规划。
RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learning
- 用图神经网络建模场景,通过强化学习自动规划多机器人动作。
- 在8台机器人完成40个任务的复杂环境中实现零样本泛化。
- 适合工业自动化、动态环境下的实时多机协同场景。
现代机器人制造需要在障碍物密集的共享工作空间中,对多台机器人进行无碰撞协调以完成大量任务。尽管单个任务简单,但满足时空约束下的自动任务分配、调度与运动规划对经典方法而言在真实规模下仍计算不可行。当前工业多机械臂系统依赖人工经验手动设计可行轨迹,耗时费力。为此,我们提出一种基于强化学习(RL)的框架,实现自动化任务与运动规划,在包含8台机器人、40个抓取任务的障碍物密集环境中测试。该方法基于图神经网络(GNN)策略,通过在程序生成的多样化环境(含不同障碍布局、机器人配置和任务分布)中训练,采用场景图表示和图策略神经网络,联合求解任务分配、调度与运动规划问题。模型在仿真中大规模随机任务集上训练,可零样本泛化至未见过的设置,包括不同的机器人位置、障碍物几何形状和任务姿态。进一步验证其高速能力可用于工位布局优化,显著提升求解速度。该规划器的高效与可扩展性也为容错规划和在线感知重规划等新能力开辟可能,适用于需快速响应动态任务的变化场景。
原文摘要 · Abstract (English)
Modern robotic manufacturing requires collision-free coordination of multiple robots to complete numerous tasks in shared, obstacle-rich workspaces. Although individual tasks may be simple in isolation, automated joint task allocation, scheduling, and motion planning under spatio-temporal constraints remain computationally intractable for classical methods at real-world scales. Existing multi-arm systems deployed in the industry rely on human intuition and experience to design feasible trajectories manually in a labor-intensive process. To address this challenge, we propose a reinforcement learning (RL) framework to achieve automated task and motion planning, tested in an obstacle-rich environment with eight robots performing 40 reaching tasks in a shared workspace, where any robot can perform any task in any order. Our approach builds on a graph neural network (GNN) policy trained via RL on procedurally-generated environments with diverse obstacle layouts, robot configurations, and task distributions. It employs a graph representation of scenes and a graph policy neural network trained through reinforcement learning to generate trajectories of multiple robots, jointly solving the sub-problems of task allocation, scheduling, and motion planning. Trained on large randomly generated task sets in simulation, our policy generalizes zero-shot to unseen settings with varying robot placements, obstacle geometries, and task poses. We further demonstrate that the high-speed capability of our solution enables its use in workcell layout optimization, improving solution times. The speed and scalability of our planner also open the door to new capabilities such as fault-tolerant planning and online perception-based re-planning, where rapid adaptation to dynamic task sets is required.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。