arXiv:2507.21638cs.AIcs.LG2025-07中稿 · the Reinforcement …

构建可加速的多智能体助人机器人仿真平台,支持真实场景下人机协作测试。

Assistax: A Multi-Agent Hardware-Accelerated Reinforcement Learning Benchmark for Assistive Robotics

  • 基于JAX与MuJoCo-MJX,GPU加速实现412倍于传统环境的仿真速度
  • 引入可训练的拟人化伙伴,模拟不同残障与偏好下的动态协作任务
  • 提供预训练反应式人形代理,助力新型人机协同算法快速验证

尽管具身自主系统在日常生活中协助人类仍是机器人领域的核心目标,但高效的强化学习(RL)仿真测试平台仍十分稀缺。现有环境大多过于简单,或因吞吐量过低难以支撑大规模RL训练。更少有仿真支持多智能体交互——多数将机器人视为孤立个体,而真实助人任务如居家照护本就是多智能体协作过程。Assistax通过基于JAX和MuJoCo-MJX构建的、可扩展的GPU加速仿真套件,解决了上述问题,并引入可训练的人形伙伴智能体,与机器人共同参与多智能体强化学习(MARL)。我们将人机交互建模为临时团队合作(AHT)问题,要求机器人策略能泛化至未见过的人类个体及其独特偏好组合。为此,我们构建了完整的AHT基准测试流程:利用MARL预训练多样化人形伙伴群体,并评估机器人策略对保留组人形策略的协调能力。相比其他基准,我们还通过Hugging Face发布可反应的预训练人形代理,加速AHT研究迭代。硬件加速下,Assistax在单个GPU上实现了比同类CPU环境快412倍的开环仿真性能。我们的AHT流程揭示了现有强化学习算法在面对新组合偏好时存在协调差距。该原生强化学习的具身多智能体交互测试套件,为推进辅助护理中的强化学习提供了实用基准。代码已开源:https://github.com/assistive-autonomy/assistax。

原文摘要 · Abstract (English)

As embodied autonomous systems capable of assisting humans in daily activities remain a major goal for robotics, efficient and appropriate reinforcement learning (RL) simulation testbeds are increasingly important. Many common RL environments are too simple to provide insight into complex robotics domains, and many robotics simulations have throughput too low for RL. Very few simulators target multi-agent interactions: most treat the robot as an isolated agent, yet real-world tasks such as home assistance and caretaking are inherently multi-agent. Assistax addresses these limitations by providing a high-throughput, scalable suite of GPU-accelerated assistive robotics tasks built on JAX and MuJoCo-MJX, and includes an active humanoid agent as a simulated human partner, trainable alongside the robot using multi-agent RL (MARL). Beyond its use as a MARL benchmark, we formulate the human-robot interaction as an Ad-Hoc Teamwork (AHT) problem, where the robot's policy must generalise to unseen humans with varying disabilities and preferences. To this end, we provide an extensive AHT benchmarking pipeline: we use MARL to pre-train a diverse population of humanoid partners, and evaluate robot policies' ability to coordinate with a withheld set of humanoid policies. In contrast to other benchmarks, we also release reactive MARL-pre-trained humanoid policies via Hugging Face, enabling faster iteration in AHT research. With hardware acceleration, Assistax achieves up to 412$\times$ faster open-loop simulation than comparable CPU-based environments on a single GPU. Our AHT pipeline reveals a coordination gap for existing RL algorithms on unseen partners with novel preference combinations. This RL-native test suite for embodied multi-agent interaction provides a practical benchmark for advancing RL in assistive care. Code is available at: https://github.com/assistive-autonomy/assistax.

多智能体人机协作强化学习仿真加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。