用图注意力网络提升机器人探索的决策效率,兼顾路径可行性和时间优化。
GRATE: a Graph transformer-based deep Reinforcement learning Approach for Time-efficient autonomous robot Exploration
- 基于图变压器捕捉环境图的局部与全局依赖关系,增强推理能力。
- 在仿真中比顶尖方法节省21.5%距离和21.3%时间完成探索任务。
- 适用于需高效自主导航的移动机器人系统,尤其关注真实场景部署。
自主机器人探索(ARE)是机器人在未知环境中自主导航与建图的过程。现有基于强化学习的方法通常将ARE建模为在无碰撞信息图上的序列决策问题,但这些方法对图结构数据的推理能力有限。此外,由于未充分考虑机器人运动特性,所得策略往往仅优化行程距离,忽视时间效率。为此,我们提出GRATE,一种基于深度强化学习的方法,利用图变压器有效捕捉信息图的局部结构模式与全局上下文依赖,从而提升模型在整个环境中的推理能力。同时,采用卡尔曼滤波平滑路径点输出,确保生成路径具有运动学可行性。实验结果表明,本方法在多个仿真基准测试中表现出更优的探索效率,探索距离减少最多达21.5%,耗时减少最多达21.3%。我们还在真实场景中验证了该规划器的有效性。
原文摘要 · Abstract (English)
Autonomous robot exploration (ARE) is the process of a robot autonomously navigating and mapping an unknown environment. Recent Reinforcement Learning (RL)-based approaches typically formulate ARE as a sequential decision-making problem defined on a collision-free informative graph. However, these methods often demonstrate limited reasoning ability over graph-structured data. Moreover, due to the insufficient consideration of robot motion, the resulting RL policies are generally optimized to minimize travel distance, while neglecting time efficiency. To overcome these limitations, we propose GRATE, a Deep Reinforcement Learning (DRL)-based approach that leverages a Graph Transformer to effectively capture both local structure patterns and global contextual dependencies of the informative graph, thereby enhancing the model's reasoning capability across the entire environment. In addition, we deploy a Kalman filter to smooth the waypoint outputs, ensuring that the resulting path is kinodynamically feasible for the robot to follow. Experimental results demonstrate that our method exhibits better exploration efficiency (up to 21.5% in distance and 21.3% in time to complete exploration) than state-of-the-art conventional and learning-based baselines in various simulation benchmarks. We also validate our planner in real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。