提出可本地通信的多智能体路径规划模型,提升协作效率且不牺牲扩展性。
Learning to Communicate Locally for Large-Scale Multi-Agent Pathfinding

- 引入可学习的局部通信模块,让邻近智能体共享信息增强协作
- 在未见场景中优于现有基于强化与模仿学习的方法,成功率更高
- 保持良好扩展性,适合大规模机器人协同任务
多智能体路径规划(MAPF)是多机器人轨迹规划的通用抽象,多个同质智能体在共享环境中同时移动。尽管最优求解MAPF属于NP难问题,但高效可扩展的求解器对物流、搜救等实际应用至关重要。当前研究已提出多种基于机器学习的去中心化次优解法,将MAPF建模为从单个智能体视角出发的Dec-POMDP,每一步基于局部观测决策,通常通过强化学习或模仿学习求解。本文沿用此框架,额外引入可学习的通信模块,以提升智能体间协作效率。提出局部通信多智能体路径规划(LC-MAPF),通过多轮邻近智能体间的信息交换,改善协调能力。实验表明,该方法在多样化的未见过测试场景中,于多项指标上均优于现有学习型MAPF算法,包括基于模仿学习和强化学习的方法。值得注意的是,所提通信机制未影响LC-MAPF的可扩展性,突破了通信类方法常见的性能瓶颈。
原文摘要 · Abstract (English)
Multi-agent pathfinding (MAPF) is a widely used abstraction for multi-robot trajectory planning problems, where multiple homogeneous agents move simultaneously within a shared environment. Although solving MAPF optimally is NP-hard, scalable and efficient solvers are critical for real-world applications such as logistics and search-and-rescue. To this end, the research community has proposed various decentralized suboptimal MAPF solvers that leverage machine learning. Such methods frame MAPF (from a single agent perspective) as a Dec-POMDP where at each time step an agent has to decide an action based on the local observation and typically solve the problem via reinforcement learning or imitation learning. We follow the same approach but additionally introduce a learnable communication module tailored to enhance cooperation between agents via efficient feature sharing. We present the Local Communication for Multi-agent Pathfinding (LC-MAPF), a generalizable pre-trained model that applies multi-round communication between neighboring agents to exchange information and improve their coordination. Our experiments show that the introduced method outperforms the existing learning-based MAPF solvers, including IL and RL-based approaches, across diverse metrics in a diverse range of (unseen) test scenarios. Remarkably, the introduced communication mechanism does not compromise LC-MAPF's scalability, a common bottleneck for communication-based MAPF solvers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。