arXiv:2608.25864cs.RO2026-08

让多机械臂协作更灵活,能组合新动作模式。

MA-VLA: Multi-Arm Vision-Language-Action Model for Collaboration and Compositional Generalization

论文配图:MA-VLA: Multi-Arm Vision-Language-Action Model for Collaboration and Compositional Generalization
图 1 · 摘自论文原文
  • 将任务分解为可复用的原子动作,分给每个机械臂执行。
  • 在训练中随机交换机械臂角色,提升对新协作方式的适应能力。
  • 适合需要灵活协作的机器人系统,如工厂装配或服务机器人。

多臂协作正成为具身操作的核心能力。现有视觉-语言-动作(VLA)模型虽整合感知、语言与控制,但通常将语言视为单一全局指令,缺乏显式机制分配和组合各臂行为,限制了对训练中未见协作模式的迁移能力。本文提出MA-VLA,一种通过原子动作分配实现多臂协作的统一框架。该模型将协作行为分解为中层原子提示,并分配给各机械臂,支持显式子目标设定和跨任务的组合复用。为减少对固定执行角色的依赖,引入训练时的机械臂置换策略(Arm Shuffle),对各臂的观测、状态和分配的原子提示进行随机排列,强制实现无角色指令遵循,并支持重组为未见的协调模式,即多臂组合泛化。我们构建了一个基准测试,其中测试时的协作模式在训练集中未出现。仿真与真实世界评估显示,先前最先进的VLAs在此类未见协作下普遍失败,而MA-VLA始终成功。结果表明,基于每臂的结构化原子动作分配,是实现多臂具身系统可扩展泛化的有效路径。代码、模型与数据已开源。

原文摘要 · Abstract (English)

Multi-arm collaboration is becoming a core capability in embodied manipulation. Recent vision-language-action (VLA) models integrate perception, language, and control, but most represent language as a single global instruction and do not provide an explicit mechanism for assigning and composing arm-specific behaviors. This design limits transfer to collaboration patterns that differ from those observed during training. We present MA-VLA, a unified framework for multi-arm collaboration via atomic action assignment. MA-VLA decomposes cooperative behavior into mid-level atomic prompts and allocates them to individual arms, enabling explicit subgoal specification and compositional reuse across tasks. To reduce reliance on fixed execution roles, we introduce Arm Shuffle, a training-time permutation of the observation, state, and assigned atomic prompts for each arm. This permutation enforces role-agnostic instruction following and supports recomposition into unseen coordination patterns, which we term multi-arm compositional generalization. We also construct a benchmark in which test-time collaboration patterns are absent in training set. Across simulation and real-world evaluations, prior state-of-the-art VLAs largely fail under these unseen collaborations, while MA-VLA consistently succeeds. These results indicate that structured, per-arm atomic action assignment offers a practical route to scalable generalization in multi-arm embodied systems. Code, models, and data are available at https://github.com/zhangzaibin/future-robots

多臂协作动作规划组合泛化机器人学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。