用扩散模型生成机器人轨迹,再用强化学习引导减少碰撞。
Generative Multi-Robot Motion Planning via Diffusion Modeling with Multi-Agent Reinforcement Learning Guidance

- 每台机器人独立用扩散模型生成候选路径,保持可扩展性。
- 引入MARL训练的值函数指导生成过程,碰撞率从55.4%降至41.8%。
- 无需集中规划或重训模型,适合大规模多机协同场景。
在共享环境中协调多机器人运动需为每个智能体生成可行轨迹并考虑彼此交互。集中式规划随机器人数量增加难以扩展,而完全去中心化的规划无法自然处理交互。本文提出一种结合去中心化生成轨迹与多智能体强化学习(MARL)协调的框架。每个机器人独立使用基于单智能体数据训练的扩散模型生成候选轨迹,利用其生成可行且多样路径的能力。为降低智能体间冲突,采用通过MARL训练的集中式价值函数,以梯度引导反向扩散过程,实现交互感知的轨迹生成,无需集中联合规划或重训练生成模型。该引导遵循指数倾斜公式,使价值函数偏向具有更高预期多智能体回报的轨迹。在包含四台移动机器人的模拟迷宫环境中评估,结果表明,所提值引导扩散规划将智能体间干扰率从55.4%降至41.8%,证明了协调可在保持去中心化生成可扩展性的前提下有效实现。结果表明,基于MARL的值引导能有效为去中心化生成器引入协调能力,而无需完整联合多智能体模型。
原文摘要 · Abstract (English)
Coordinating multiple robots in shared environments requires generating feasible trajectories for each agent while accounting for interactions among agents. Centralized planning approaches become difficult to scale as the number of robots increases, while decentralized approaches that allow each agent to plan independently do not inherently account for inter-agent interactions. This paper presents a framework for coordinated multi-robot motion planning that combines decentralized generative trajectory planning with multi-agent reinforcement learning (MARL)-based coordination. Each robot independently generates candidate trajectories using a diffusion model trained on single-agent motion data, leveraging the generative model's ability to produce feasible and diverse trajectories. To reduce conflicts between agents, a centralized value function trained via MARL guides the reverse diffusion process through gradient-based steering, enabling interaction-aware trajectory generation without centralized joint planning or retraining of the generative model. This guidance follows an exponential tilting formulation, in which the value function biases the denoising distribution toward trajectories with higher expected multi-agent return. The framework is evaluated in a simulated maze environment with four mobile robots. Experimental results show that the proposed value-guided diffusion planning reduces the inter-agent interference rate from 55.4% to 41.8%, demonstrating that coordination can be effectively achieved while preserving the scalability of decentralized trajectory generation. These results suggest that MARL-based value guidance can effectively introduce coordination into decentralized generative planners without requiring a fully joint multi-robot model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。