arXiv:2410.19373cs.RO2024-10被引 1

多机器人探索新框架,兼顾效率与长远规划。

An Enhanced Hierarchical Planning Framework for Multi-Robot Autonomous Exploration

  • 分三层规划:先找前沿点建稀疏地图,再用图网络算任务优先级,最后局部搜索路径。
  • 比基线少30%以上数据传输,探索耗时更短,验证了高效性。
  • 适合救援、探测等需协同的复杂环境任务,尤其关注通信成本。

多机器人自主探索在救援、勘探等领域具有重要意义。现有方法或依赖贪婪前沿选择,或采用端到端深度强化学习(DRL),但常受限于短视、忽略长期影响及高维空间收敛困难。本文提出一种创新集成框架,融合前沿法的低维动作空间优势与DRL的远见性与最优性。首先在自由空间识别前沿点,构建稀疏地图以减轻数据传输负担并降低DRL动作空间维度;其次设计多图神经网络(mGNN),融合目标与机器人状态,基于策略强化学习计算亲和度,替代传统启发式效用值;最后通过子序列搜索实现局部路径规划,避免全序列遍历。在多种场景下进行充分验证,仿真结果表明,相比基线方法,本框架在减少超过30%数据传输的同时,以更少时间步完成环境探索,显著提升效率与性能。

原文摘要 · Abstract (English)

The autonomous exploration of environments by multi-robot systems is a critical task with broad applications in rescue missions, exploration endeavors, and beyond. Current approaches often rely on either greedy frontier selection or end-to-end deep reinforcement learning (DRL) methods, yet these methods are frequently hampered by limitations such as short-sightedness, overlooking long-term implications, and convergence difficulties stemming from the intricate high-dimensional learning space. To address these challenges, this paper introduces an innovative integration strategy that combines the low-dimensional action space efficiency of frontier-based methods with the far-sightedness and optimality of DRL-based approaches. We propose a three-tiered planning framework that first identifies frontiers in free space, creating a sparse map representation that lightens data transmission burdens and reduces the DRL action space's dimensionality. Subsequently, we develop a multi-graph neural network (mGNN) that incorporates states of potential targets and robots, leveraging policy-based reinforcement learning to compute affinities, thereby superseding traditional heuristic utility values. Lastly, we implement local routing planning through subsequence search, which avoids exhaustive sequence traversal. Extensive validation across diverse scenarios and comprehensive simulation results demonstrate the effectiveness of our proposed method. Compared to baseline approaches, our framework achieves environmental exploration with fewer time steps and a notable reduction of over 30% in data transmission, showcasing its superiority in terms of efficiency and performance.

多机器人强化学习路径规划稀疏地图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。