arXiv:2411.16134cs.RO2024-11被引 3

多机器人在不确定地图中实时导航,提升准时到达率。

Multi-Robot Reliable Navigation in Uncertain Topological Environments with Graph Attention Networks

  • 用图注意力网络动态捕捉环境变化,实现自适应路径规划。
  • 在多个真实交通网络中,准时到达率比现有方法最高提升23%。
  • 适合复杂动态环境下的多机器人协同导航,如智能物流、搜救任务。

本文研究不确定拓扑环境下多机器人可靠导航问题,旨在最大化团队在道路网络不确定性下的准时到达概率。网络不确定性源于边的通行性未知,仅在机器人抵达边起点时才可知。现有方法难以应对实时拓扑变化,不适用于动态环境。为此,我们将问题重构为部分可观测马尔可夫决策过程(POMDP),提出动态自适应图嵌入方法以捕捉导航任务的演化特性。通过结合深度强化学习与图注意力网络(GATs),利用自注意力机制聚焦关键图特征,增强各机器人的策略学习。所提方法MARVEL采用广义策略梯度算法,迭代优化机器人实时决策过程。我们在一系列典型交通网络中对比MARVEL与先进可靠导航算法及加拿大旅行者问题求解器,结果表明其在不确定拓扑网络中具有更强适应性与性能。此外,两台机器人在自建室内不确定拓扑环境中进行的真实实验验证了MARVEL的实用性。

原文摘要 · Abstract (English)

This paper studies the multi-robot reliable navigation problem in uncertain topological networks, which aims at maximizing the robot team's on-time arrival probabilities in the face of road network uncertainties. The uncertainty in these networks stems from the unknown edge traversability, which is only revealed to the robot upon its arrival at the edge's starting node. Existing approaches often struggle to adapt to real-time network topology changes, making them unsuitable for varying topological environments. To address the challenge, we reformulate the problem into a Partially Observable Markov Decision Process (POMDP) framework and introduce the Dynamic Adaptive Graph Embedding method to capture the evolving nature of the navigation task. We further enhance each robot's policy learning process by integrating deep reinforcement learning with Graph Attention Networks (GATs), leveraging self-attention to focus on critical graph features. The proposed approach, namely Multi-Agent Routing in Variable Environments with Learning (MARVEL) employs the generalized policy gradient algorithm to optimize the robots' real-time decision-making process iteratively. We compare the performance of MARVEL with state-of-the-art reliable navigation algorithms as well as Canadian traveller problem solutions in a range of canonical transportation networks, demonstrating improved adaptability and performance in uncertain topological networks. Additionally, real-world experiments with two robots navigating within a self-constructed indoor environment with uncertain topological structures demonstrate MARVEL's practicality.

多机器人导航图注意力网络强化学习不确定环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。