10分钟内完成多机器人强化学习策略的训练与部署。
JaxRobotarium: Training and Deploying Multi-Robot Policies in 10 Minutes
- 基于Jax构建,支持并行化与硬件加速,实现快速训练。
- 在真实机器人平台上实现20倍训练提速、150倍仿真加速。
- 提供8个标准化协作任务,支持从仿真到真实的无缝迁移。
多智能体强化学习(MARL)为多机器人系统中复杂且可扩展的协调行为学习提供了有前景的解决方案。然而,现有MARL平台(如SMAC和MPE)缺乏机器人相关性与硬件部署能力,导致研究人员需自行开发专用环境与实验平台。最近的MARBLER平台虽将Robotarium实验台与现有MARL软件基础设施结合,但未支持并行化与GPU/TPU计算,速度远低于现代MARL环境。本文提出JaxRobotarium,一个基于Jax的端到端仿真、学习、部署与基准测试平台,支持真实机器人动力学与安全约束,具备并行化与硬件加速能力。其通用学习接口可轻松集成主流MARL库(如JaxMARL)。平台包含8个标准化协作场景,其中4个为新引入任务,将经典MARL基准(如RWARE和层级觅食)迁移至真实机器人场景。实验表明,JaxRobotarium在保持高仿真保真度的同时,相较基线实现20倍训练加速和150倍仿真加速,并通过Robotarium提供开源的仿真到真实评估管道,显著加速并推动多机器人学习研究的普及。代码已公开于https://github.com/GT-STAR-Lab/JaxRobotarium。
原文摘要 · Abstract (English)
Multi-agent reinforcement learning (MARL) has emerged as a promising solution for learning complex and scalable coordination behaviors in multi-robot systems. However, established MARL platforms (e.g., SMAC and MPE) lack robotics relevance and hardware deployment, leaving multi-robot learning researchers to develop bespoke environments and hardware testbeds dedicated to the development and evaluation of their individual contributions. The Multi-Agent RL Benchmark and Learning Environment for the Robotarium (MARBLER) is an exciting recent step in providing a standardized robotics-relevant platform for MARL, by bridging the Robotarium testbed with existing MARL software infrastructure. However, MARBLER lacks support for parallelization and GPU/TPU execution, making the platform prohibitively slow compared to modern MARL environments and hindering adoption. We contribute JaxRobotarium, a Jax-powered end-to-end simulation, learning, deployment, and benchmarking platform for the Robotarium. JaxRobotarium enables rapid training and deployment of multi-robot RL (MRRL) policies with realistic robot dynamics and safety constraints, supporting parallelization and hardware acceleration. Our generalizable learning interface integrates easily with SOTA MARL libraries (e.g., JaxMARL). In addition, JaxRobotarium includes eight standardized coordination scenarios, including four novel scenarios that bring established MARL benchmark tasks (e.g., RWARE and Level-Based Foraging) to a robotics setting. We demonstrate that JaxRobotarium retains high simulation fidelity while achieving dramatic speedups over baseline (20x in training and 150x in simulation), and provides an open-access sim-to-real evaluation pipeline through the Robotarium testbed, accelerating and democratizing access to multi-robot learning research and evaluation. Our code is available at https://github.com/GT-STAR-Lab/JaxRobotarium.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。