arXiv:2606.15550cs.RO2026-06

用扩散模型一次性生成多机器人协调轨迹,避免逐个规划的冲突问题。

Robots as Tokens: Unified Diffusion Transformer for Coordinated Multi-Robot Trajectory Generation

论文配图:Robots as Tokens: Unified Diffusion Transformer for Coordinated Multi-Robot Trajectory Generation
图 1 · 摘自论文原文
  • 把机器人当离散符号,通过自注意力实现协同交互与环境感知。
  • 在复杂环境中生成轨迹成功率超基线方法,支持不同数量机器人的灵活调度。
  • 适合需要多机协同、动态环境适应的机器人任务场景。

生成模型在语言和视觉生成中的成功启发了其在机器人规划中的应用。然而,现有方法大多聚焦单机器人规划,或采用顺序生成方式并需迭代后处理解决机器人间冲突。本文探讨是否可将多机器人协调轨迹这一特殊时空分布,以端到端前馈方式由生成模型学习并生成。提出Roken(Robots as Tokens)——一种统一的扩散变换器,直接生成满足个体安全与全局连通性约束的多机器人轨迹。核心设计是将每个机器人表示为离散令牌,通过自注意力机制自然交互,并跨注意力关注地图令牌以感知环境布局。进一步基于贝叶斯定理引入多个辅助任务,提供多尺度时空监督以高效学习条件分布。训练时,Roken吸收来自不同团队规模的多样专家轨迹;推理时,可作为通用多机器人规划器,支持单机器人规划、协同轨迹生成及固定部分机器人作为条件的条件生成。在多种杂乱环境中的实验表明,Roken能以高成功率生成满足连通性约束的目标导航轨迹,优于用于生成训练数据集的基线方法。训练后具备良好可扩展性,且能在未见过或部分观测的环境中泛化,验证其从多样化数据中学习并执行多种任务的潜力。

原文摘要 · Abstract (English)

The success of generative models in language and visual generation has inspired extensive applications to generative robot planning. However, most existing works either focus on single-robot planning, or generate multi-robot trajectories in a sequential manner with iterative post-processing to resolve inter-robot conflicts. In this work, we investigate whether coordinated multi-robot trajectories, as a special spatiotemporal distribution, can be learned and generated with a generative model in a feed-forward manner. We propose Robots as Tokens (Roken), a unified diffusion transformer that directly generates multi-robot trajectories that satisfy both (individual) safety and (global) connectivity constraints. The core design of Roken is to represent each robot as a discrete token, allowing them to naturally interact with each other through self-attention, and cross-attend to map tokens for environment layouts. We further introduce several auxiliary tasks based on Bayes' theorem to provide multi-scale spatial-temporal supervision for efficient learning of the conditional distribution. In training, Roken absorbs diverse expert trajectories from different team sizes. During inference, Roken behaves as a versatile multi-robot planner that can handle single-robot planning, coordinated multi-robot trajectory generation, and conditional trajectory generation by fixing some robot tokens as conditions. Experiments in diverse cluttered environments show that Roken can generate coordinated multi-robot trajectories to perform connectivity-constrained goal navigation tasks with high success rates, outperforming the baseline method used to generate the training dataset. Roken also demonstrates good scalability after training with mixed team sizes, and shows generalization to unseen or partially observed environments, verifying its potential to learn from diverse data and perform versatile tasks.

多机器人扩散模型轨迹生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。